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ABSTRACT 


This thesis contains an exhaustive analytical and numerical inves- 
tigation of stability and robustness properties of a wide class of / 
adaptive control algorithms in the presence of unmodeled dynamics , 
and output disturbances. The class of adaptive algorithms considered 
are those commonly referred to as model reference adaptive control 
algorithms , self-tuning controllers, and dead beat adaptive controllers 
they have been developed for both continuous-time systems and discrete- 
time systems. The existing adaptive control algorithms have been 
proven to be globally asymptotically stable under certain assumptions, 
the key ones being (a) that the number of poles and zeroes of the 
unknown plant are known, and (b) that the primary performance cri- 
terion is related to good command following. These theoretical as- 
sumptions are too restrictive from an engineering point of view. 

Real plants always contain unmodeled high-frequency dynamics and 
small delays, and hence no upper bound on the number of the plant 
poles and zeroes exists. Also real plants are always subject to 
unmeasurable output additive disturbances, although these may be 
small. Hence, it is important to critically examine the stability 
robustness properties of the existing adaptive algorithms when some 
of the theoretical assumptions are removed, in particular, their 
stability and performance properties in the presence of unmodeled 
dynamics and output disturbances. 


A unified analytical approach has been developed that can be used to 
examine the class of existing adaptive algorithms. It was discovered 
that all existing algorithms contain an infinite-gain operator in the 
dynamic system that defines command reference errors and parameter 
errors; it is argued that such an infinite gain operator appears to 
be generic to all adaptive algorithms, whether they exhibit explicit 
or implicit parameter identification. The practical engineering 
consequences of the existence of the infinite-gain operator are 
disasterous. Analytical and simulation results demonstrate that 
sinusoidal reference inputs at specific frequencies and/or sinusoidal 
output disturbances at any frequency including d.c. cause the loop 
gain of the adaptive control system to increase without bound, thereby 
exciting the (unmodeled) plant dynamics, and yielding an unstable 
control system. Hence, it is concluded that none of the adaptive 
algorithms considered can be used with confidence in a practical 
control system design, because instability will set in with a high 
probability. 


Thesis Co-Supervisor: Dr. Michael Athans 

Title: Professor of Systems Science and Engineering 


Thesis Co-Supervisor: Dr. Lena Valavani 

Title: Research Scientist, Laboratory for Information 

and Decision Systems 
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CHAPTER 1 
INTRODUCTION 

1.1 Introduction 

The development of a systematic design methodology for the 
synthesis of practical self-adjusting control systems which can maintain 
first stability and second performance improvement , in the presence of 
rapid and large variations in the open- loop dynamics, represents a very 
important generic goal in control systems engineering, in view of its 
wide applicability to industrial and defense applications. The so- 
called "adaptive control problem" has received attention by theoreticians 
and practitioners alike for the past 25 years. About a dozen books and 
hundreds of articles have been devoted to the subject; different 
philosophies have been developed (model reference adaptive control, self- 
tuning regulators, dual-control methods, multiple-model adaptive 
control, etc.) and a variety of (mostly academic) examples have been 
simulated. 

If classes of practical adaptive control algorithms were available, 
then numerous application areas would benefit in both the military and 
commercial sectors. Advances in microprocessor technology allow the 
engineer to implement in real-time the nonlinear, time-varying algorithms 
necessary to implement the adaptive dynamic compensator necessary to 
stabilize and improve the performance of a plant with poorly understood 


characteristics . 
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We present below a typical, but non- exhaustive, list of problems 
of practical importance that will benefit from the development of 
practical adaptive control algorithms. It should be noted that in 
these typical application areas the common characteristic is that 
the physical system to be controlled is characterized by rapidly 
changing dynamics; also, the application requires a consistent improve 
ment in performance. 

(a) Design of stability augmentation systems of highly 
maneuverable aircraft. In this class of problems 
rapid changes in dynamic pressure and operation in 
high angle of attack and high sideslip environments 
result in very variable effectiveness of aerodynamic 
surfaces; the aircraft stability augmentation system 
must rapidly adapt to such dynamic pressure variations. 

(b) High performance surface-to-air and air-to-air missiles. 
Similar problems as in (a) arise in the design of the 
autopilot of highly maneuverable interceptor missiles 
capable of non-nuclear kill (NNK) of highly maneu- 
verable and evasive targets; rapid changes in the 
aerodynamic characteristics can be expected in the 
end-game portion of the engagement as the target 
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undergoes last-ditch evasive maneuvers. The 
missile autopilot must maintain a high bandwidth 
to cope with the rapid changes in the commanded 
signals, and to compensate for changes in the 
low frequency missile dynamics. 

We remark that the issues presented in (a) and (b) above are also 
present in problems involving the control of submarines and of 
torpedos. High speed submarine maneuvers can stress the stability 
of a fixed (non-adaptive) control system . Highly maneuverable 
torpedos present similar problems as missiles. 

Different adaptive control problems are present in the process 
control area. It is widely recognized that more sophisticated control 
systems than the traditional Proportional-Integral-Derivative (PID) 
controller can increase the productivity and improve the energy 
efficiency of many processes. The stumbling block is that even 
reasonable finite dimensional dynamic models for such processes are 
extremely difficult to obtain, due to the complexity of the thermo- 
dynamic relations and the inevitable transport delay phenomena. 

The above examples are representative and they are not meant to 
be exhaustive. For most control systems, some need for adaptation 
exists; the design of high-energy laser systems, active control 
flexible structures (space structures, towed arrays etc.), the 
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control of advanced turbofan engines, and emergency control of power 
systems represent additional major prospects for good adaptive 
control. 

By the end of the 1970 ' s considerable progress had been made 
in the theory of adaptive control systems. Specifically, model 
reference adaptive control algorithms were proposed in the 
literature which, under certain assumptions, achieved 
global asymptotic stability; that is, no matter what initial values 
and reference inputs were used ,the output of the controlled plant 
would asymptotically match the output of the reference model 
[3-12] . In addition, unification work was performed to enable 
other algorithms, such as certain types of self-tuning regulator 
designs to be viewed as special cases of model reference adaptive 
control [13,14]. 

Unfortunately, the stability proofs of all these algorithms 
have in common a very restrictive assumption. For continuous- 
time implementations this assumption is that the relative degree 
of the plant, i.e., its number of poles minus its number of 
zeroes, is known. This implies that the phase of the system is 
known for high frequencies. On the other hand, it is a well known 
fact that models of physical systems become very inaccurate in 
describing high frequency phase characteristics. Indeed, 


relative degree is not even a well-defined quantity for infinite 
dimensional systems. Finally, for practical reasons, most 
controller designs need to be based on models which do not contain 
all of the plant's dynamics in order to keep the complexity of 
the compensator within bounds. Consequently, it is imperative to 
explore the behavior of adaptive control algorithms when the 
unrealistic, from an engineering viewpoint, relative degree as- 
sumption is violated. 

The counterpart of the relative degree assumption for discrete- 
time adaptive control algorithms is that the pure delay in the plant 
is exactly an integer number of sampling periods and that this 
integer is known. In addition, it is assumed that the degree of 
the model of the plant is at least equal to the degree of the plant 
itself. Again, these are mathematical assumptions that are violated 
in any practical control design. The delay of a plant is rarely 
known precisely and is often a. variable quantity. Even more 
importantly the actual order of a system is often prohibitively high 
or even infinite. 

Another problem with the published algorithms is that there 
has been no statement as to how the algorithms will react when 
presented with general disturbances, especially additive output 
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disturbances. Indeed only one algorithm includes any disturbance 
consideration at all and that consists of a disturbance of a very 
particular structure. [12]. 

This thesis deals with a problem that, until the initiation of 

the research reported upon here, had not been dealt with in the 

* 

adaptive control literature. A simple statement of the problem 
is as follows: 

How will the published adaptive control algorithms behave 
if they are designed assuming that the nominal system has a certain 
order and are implemented on a system consisting of the assumed 
nominal system in series with another system? The second system 
will represent the unmodeled dynamics of the plant. Such unmodeled 
dynamics will be thought of as affecting only the high-frequency 
behavior of the system. 

It will be seen in the sequel that in order to design an 
adaptive control system which behaves well, even in the disturbance 
free case, in the presence of such high-frequency unmodeled dynamics 
requires great care and insight. 




In 1976 a visiting postdoctoral fellow at MIT, Dr. Martin- Sanchez, under 
the supervision of Professor Athans, conducted some (unpublished) simula- 
tions of the Model Reference Adaptive Control algorithm for the F-8 
Aircraft longitudinal dynamics. In the absence of any sensor noise sim- 
ulations of the adaptive algorithm performed extremely well over a very 
wide range of operating conditions. However, even in the presence of 
very small additive sensor noise, the algorithm performed very poorly 
even in the absence of unmodeled dynamics. 
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tlowevor, it will also bo soon that even carefully designed 
systems encounter grave instability problen* if, in addition to the 
high frequency unmodeled dynamics , they encounter even small 
sinusoidal output disturbances at any frequency. Since the deiagner 
cannot control the disturbance environment in which a control system 
operates, and since physical systems always have unmode led dynamics 
at sufficiently high frequencies, one cannot use any of the adaptive 
control algorithms examined in this thesis with confidence in 
engineering applications, because they will lead to unstable systems 
with high probability. 

1.2 A Survey of the More Recent Adaptive Control Literature 

The adaptive control algoritluns studied in this dissertation have 
their roots in the solutions to the "adaptive observer" problem. An 
"adaptive observer" is a system which simultaneously estimates the 
states and parameters of an unknown linear system. 

Th& ’’adaptive observer" problem for single-input single-output 
linear time-invariant systems was well understood by the mid 1970’s. 

Many different versions of globally asymptotically stable adaptive 
observers - of minimal and nonminimal orders - appeared in the 
literature US-22) and their stability and convergence properties 
were analysed 123-25) . The results reported in [15-25) were obtained with 
the additional assumptions of exact process modelling and the absence 
of process and/or measurement noise. 
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At about the s junta time, attention was then shifted to what 
could be considered the logical continuation of the adaptive 
observer problem) namely, the design of an adaptive controller for 
the same class of systems and under the same assumptions mentioned 
above. However, contrary to the expectations of research vjorkers, 
its solution did not follow directly from the solutions obtained 
for the adaptive observer, except in the case where the entire 
state vector of the plant was assumed accessible [18] . 

The complications arose in the control problem, on the one hand, 
when it was attempted to design a controller for an unknown plant 
using its input-output data alone and with no accessibility to any 
other point) on the other hand, due to noises considerations, explicit 
use of differentiators was to be excluded. The difficulty was 
enhanced further by the feedback configuration used in the case of 
control, which gave rise to nonlinear time- varying differential 
equations for the adaptive loop unlike the linear dynamics which 
pertained in the open-loop adaptive observer problem. 

An important contribution in the design of an adaptive con- 
troller was made by Monopoli [26] who suggested an ingenious scheme 
for control that removed the need for differentiators by use of an 
augmented error signal. 

In 1978, motivated by Monopolies idea of using an augmented error 
signal two advances came about. feuer and Morse [4] created an 
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adaptive control algorithm which also claimed asymptotic stability 
of the adaptive loop, although it was clearly too complex to be of 
any practical value except in very simple cases. Narendra and 
Valavani [3J succeeded in designing a simple controller structure 
whose stability was proven for the cases when the relative degree 
of the plant (the number of poles minus the number of zeroes) was 
loss than three. The stability of the algorithm was conjectured for 
the cases of relative degree greater than three. This conjecture 
remains unresolved. We note that all the above algoritduns were 
designed for continuous- time systems. 

Based upon this framework, the stable adaptive control problem 
broke open by 1980. At the same time, papers were published in 
which Narendra, bin, and valavani IS] proved a modified version of 
the original conjecture of 13] , Morse t<S] simplified his algorithm, 
while Narendra and Lin t7] had proved asymptotic stability for the 
discrete-time version of the algorithm of [5] and Goodwin, Ramadge, 
and Caines [10] had developed a series of their own globally 
asymptotically stable discrete-time adaptive control algorithms, 
which were motivated from entirely different considerations than the 
algorithms mentioned so far. Shortly thereafter, Landau [9] ex- 
tended a stability theorem of Landau and Silveira [8] which, when 
applied to the formulation of [7], created another algorithm. 


Elliott [27] has recently created a hybrid algorithm. Egardt 
[11,12] has created algorithms for both continuous-time and 
discrete- time. 

The algorithms mentioned in the foregoing have been proven 
globally asymptotically stable under appropriate assumptions on the 
controlled plant. The required assumptions are that the plant be a 
minimum phase SISO linear time-invariant system, whose relative 
degree and the sign of the high frequency gain are known, along 
with an upper bound on the plant order and on the magnitude of the 
high frequency gain. Under the above assumptions, these algorithms 
produce systems whose output asymptotically matches the output of a 
given reference model when presented with the same reference input. 

In addition, the parameter errors and state variables of these 
systems remain bounded. All of the algorithms mentioned above, 
except for one of the three algorithms presented in [10] , are of the 
direct control type. Furthermore, the results obtained hold only 
in the purely deterministic case and their stability analysis does 
not account for the effects of unmodeled dynamics at high frequencies. 

At the same time, or even earlier, progress was being made in 
the ania of indirect adaptive control. In this approach, an adaptive 
observer is used to identify the plant parameters and estimate the 
plant state. This information is then used to synthesize an appropriate 
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control signal. Astrom and his co-workers 128-31] , Kreisselmeier 
[32-33] , and Elliott and Wolovich [34] have created indirect 
algorithms which, while requiring fewer assumptions on the plant, do 
require instead "sufficiently rich" signals (in the adaptive loop) 
for general stability. In [33] , Kreisselmeir also proves stability 
under zero reference input without any "richness" assumptions. The 
work of Egardt did much to increase the understanding of the similarities 
in the various approaches to adaptive control by creating new general 
algorithms [11,12] which contained algorithms such as those of [5]- 
[10] and [28-31] as special cases as shown in [13,14]. 

Another trend during the 1970's was the examination of sto- 
chastic adaptive control problems including process and measurement 
noise. The adaptive control problem was posed as a stochastic 
optimal control problem and several algorithms - mostly iterative 
in nature - were developed by approximating the dynamic programming 
solution. This led to the development of the so-called dual control 
methdology, surveyed by Athans and Varaiya [35] and in a more recent 
paper by Bar-Shalom in [36] . 

As mentioned earlier, after the first designs of adaptive 
observers appeared in the literature, considerable research effort 
was directed in the more detailed analysis of the (uniform) asymptotic 
stability properties of these newly designed algorithms. Such studies 
were carried out by Anderson [23] , Yuan and Wonham [25] , and Morgan and 
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Narendra [241 » who obtained sufficient conditions for asymptotic 
stability in terms of different aspects of a "persistently spanning" 
property for the combined state and input vector of the adaptive 
process. The problem of accurately estimating plant parameters was 
also addressed from an optimization point of view* in terms of an 
optimal choice of inputs, by many researchers, among whom are Aoki and 
Staley [37], Goodwin, et.al. [38], Reid [39], Nahi and Napjus [40], 
Keviczky [41], Lopez-Toledo and Athens [42], Chen [43], and Mehra 
[44]. Unfortunately, the "persistent excitation" requirement which 
is invariably present, in some form or another in the literature 
cited above, cannot be guaranteed to hold globally in a closed loop 
system, although Kreisselmeier showed that it can be preserved 
locally [32] . 

The presence of observation noise, in the earlier literature, 
was dealt with by adopting time-decreasing adaptation gains [45] , in 
the already existing algorithms, along the lines suggested by sto- 
chastic approximation methods, and without any formal proofs. 

The most significant research in the rigorous study of such adaptive 
systems was carried out by Ljung [46,47] who introduced his ordinary- 
differential equations (ODE) approach, to study the convergence 
properties of discrete-time stochastic adaptive algorithms in terms 
of the properties of am ordinary differential equation associated 
with each one of them. 
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The approach is asymptotic and the results valid only locally, 
in certain domains in parameter space, within which the "adjusted" 
system is stable. The developed theory, however, cannot define in 
a precise manner what these domains are, or guarantee that the 
adaptive system is actually evolving within one of them. More re- 
cently, Goodwin, et.al., [48,49] obtained mean- square boundedness 
of the output error for the stochastic adaptive algorithm which 
was a modified version of [10] , in which positive realness of the 
noise transfer function was required. Again, all the above results 
were obtained under the assumption of perfect modeling. 

Due to the fact that little theoretical work has been done to 
analyze the behavior of adaptive control algorithms under conditions 
which are anything less than ideal, there is a limited experience 
regarding their use in practical applications. The collection [50] 
provides a reasonable sampling of the present practical applications 
of adaptive control theory. 

Only very recently some progress has been made in theoretical 
studies of adaptive algorithms , based on more practically realistic 
and relaxed assumptions. Preliminary results of the research presented 
in this dissertation have appeared in the literature. In Rohrs, et.al., 

[1] , simulation studies which displayed the dangerous effects of 
unmodeled dynamics on one adaptive control algorithm were reported. 

In Rohrs, et.al. [2], the effects seen in [1] were displayed analytically 
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for first order systems and a number of algorithms. Chapter 3 and 
Section 5.1 of this thesis are expansions of the work reported in [2]. 

Ioannou and Kokotovic [51] used singular perturbation methods to 
study the properties of adaptive observers in the presence of unmodeled 
dynamics. Although this paper does not deal with closed loop adaptive 
control, the results demonstrate that significant errors can occur when 
the high frequency dynamics get excited. Furthermore, they showed that 
the parameter errors can remain bounded and that their bound becomes 
tighter as the unmodeled dynamics become faster and the input used 
becomes smoother. Ioannou [52] and Ioannou and Kokotovic [53] have 
recently extended their singular perturbation approach to include the 
adaptive control algorithm of [3] * They show that this algorithm will 
remain locally stable in the presence of very high frequency unmodeled 
dynamics and zero reference input. They also show that a modified 
version of the algorithm will remain locally stable in the presenca of 
very high frequency unmodeled dynamics with low frequency reference inputs. 
There is no study of the effects disturbances in these papers. 

Anderson and Johnson [54-55] and Anderson and Johnstone [56] have 
shown that, with a "sufficient excitation" condition, discrete- time 
adaptive observers and the adaptive control scheme of [10] become not only 
asymptotically stable but also exponentially stable and thus should retain 
stability in the presence of disturbances. Since exact parameter 
convergence, however, was a key factor in obtaining the above results, 


-35- 


they cannot apply in the control scheme of e.g. [5], when unmodeled 
dynamics are present; it is not clear in such a case what parameter 
convergence to the "true” values really means. Notwithstanding, it 
is shown in Section 5.1.1 of this thesis that the algorithm of [10] is 
of a particular form that, despite relatively good performance 
under exact modeling ass sumptions, is extremely sensitive to unmodeled 
dynamics and is therefore of limited practical use. Despite their 
theoretical importance, the results in [54-56] do not provide an es- 
timate of the order of the exponential stability; hence the amount of 
modeling error that can be tolerated is not predictable even under the 
assumptions of perfect modeling. Besides, one should also be cautious 
of the adverse effects that such "sufficient excitations"’ can have on 
the stability properties of the overall system under imperfect 
modeling. 

Finally, Narendra and Peterson i57] and Kreisselmeier and 
Narendra [58] produced some ad hoc and highly restrictive modifications 
of known algorithms to insure bounded errors in the presence of 


disturbances 
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1.3 Contributions of this Thesis 

In this thesis, th* behavior of adaptive control algorithms 
is analyzed when such algorithms are implemented on systems which 
contain dynamics that are not modeled as part of the adaptive 
control design process. Such dynamics will be referred to as un- 
modeled dynamics. The behavior of adaptive control algorithms 
operated in the presence of constant and sinusoidal output distur- 
bances is also examined. 

The contributions to the theory of adaptive control are as 
follows : 

• the demonstration of an analysis method for evaluating 
the behavior of adaptive control algorithms when such 
algorithms are implenented in the presence of unmodeled 
dynamics and used with constant inputs in a disturbance- 
free environment. Tie analysis method proves to be 

insightful and constructive despite the fact that it is 

/ 

applicable under rather restrictive assumptions j 
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• The isolation of an infinite gain operator inherently 
present in the design of adaptive control 
algorithms and the demonstration that in the 
presence of unmodeled dynamics such infinite gain 
operators lead to unstable responses to certain 
classes of reference inputs. 

• The demonstration of two mechanisms by which 
adaptive control algorithms react poorly to any 
sinusoidal or constant disturbance which, in 
turn, leads to unstable behavior^if unmade led 
dynamics are also present. 

In the process of developing the above points, it is shown that, 
if the assumption on the degree or relat.we degree of the plant 
is violated, the asymptotic stability properties of the adaptive 
control algorithms are lost. 

The first mechanism of instability involves the so-called error 
system loop. If the gain of this loop is too large, the loop 
bandwidth will also be large so that any unmodeled dynamics 
which are present will become excited, thus causing instability. 

The high loop gain may be attributed to the fact that, unless 
intentionally normalized, the error loop gain will be proportional 
to the square of the size of the signals in the nominal control 
system. Even when a normalization of the adaptation gains is used 
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to create an error system whose gain is independent of the size 
of the signals in the nominal control system, these gains must 
still be carefully chosen in order to limit the bandwidth of the 
error loop and not to excite unmodeled dynamics. 

A high gain error system may also result from the fact that 
for certain sinusoidal input sign; Is, the gain of the error system 
itself increases with time. This is a nonlinear effect and causes 
instability for high frequency sinusoidal inputs in the presence 
of high frequency unmodeled dynamics. 

The second mechanism for instability involves the primary 
control loop. A deterministic additive output disturbance at 
any frequency, including constant disturbances, which is not 
measured will create i situation in which the output error cam not 
be driven to zero. The parameters in the control system will 
drift in certain directions, resulting in a large gain, high band- 
width nominal control system. Such a controller will excite 
unmodeled dynamics in the plant causing instability. This second 
mechanism can also occur if the algorithm cannot attain zero error 
for reasons other than disturbances. It is conceivable for example, 
that the controller does not provide enough flexibility for the 
controlled plant complete with unmadeled dynauaics to match 
the reference model for the inputs given. This will also cause a 
steady non-zero error driving the nominal controller to high bamdwidth 
and eventual instability. 


To summarize, in this dissertation, adaptive control in the 
presence of unmodeled dynamics is exiimined and grave stability 
problems are found. Some of these problems can be alleviated by 
the use of tools developed in this thesis tha'; enable the 
designer to choose the parameters of the adapt .ve control system 
and the reference inputs wisely. However, the. - e still remains 
the debilitating problem demonstrated in this dissertation that, if 
an adaptive controller is implemented in the presence of unmodeled 
dynamics and a persistent unmeasurable output disturbance, the 
system is likely to become unstable. 

1 . 4 Outline of the Thesis 

Chapter 2 contains a few mathematical preliminaries and in- 
troduces seven adaptive algorithms which will be studied, using 
a common notation. Section 2.1 provides the necessary notation 
while Section 2.1.1 provides a primer on positive real systems and 
their role in stability proofs of feedback systems. Positive 
real ness is an important concept in the stability proofs of adaptive 
control algorithms and its introduction allows outlines of the 
stability proofs associated with some of the algorithms. From 
these stability proof outlines it becomes apparent that the as- 
sumptions made on the relative degree are very fundamental to the 
global stability proof. This argument is presented in Section 2. 2. 1.5 
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for the algorithm of Narendra and Valavani [3] and Feuer and 
Morse 14) , referred to as CA1. The remarks concerning the 
proof of CAl are directly applicable to the stability proofs of 
the other algorithms studied , namely the algorithm of Narendra, 

Lin, and Valavani [5) and the first algorithm of Morse [6] , both 
referred to as CA2, the second algorithm of Morse 16] , referred 
to as CA3, the algorithm of Egardt (11) referred to as CA4, the 
algorithm of Narendra and Lin [7) , referred to as DAI, the, 
algorithm of Goodwin, Ramadge, and Caines [10], referred to as DA2, 
and the algorithm of Egardt [12] , referred to as DA3. 

In Section 2.2 the continuous- time algorithms, CAl to CA4, 
are introduced and in Section 2.3 the discrete-time algorithms DAI 
to DA3 are introduced. The algorithms are presented with a common, 
consistent notation and the error system for each algorithm is 
developed. The equations for each algorithm are summarized in 
tabular form within each subsection. 

In Chapter 3, the analysis technique is developed for continuous' 
time algorithms with constant inputs and no disturbances. The 
technique involves linearizing the error system around a nominal 
control system. The resulting analysis proves useful in guiding 
the selection of certain important parameters that impact the 
design of adaptive control systems for a variety of conditions. 
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In Section 3.2 the concepts of the linearization analysis 
that is used throughout Chapter 3 and Section 5.1 are introduced 
and discussed. 

In Section 3.3 it is shown that the gain of the error system 
of CA1, the simplest adaptive system, is proportional to the 
square of the magnitude of the signals present in the controller. 

In Subsection 3.3.2 it is shown that too large a reference input 
signal will produce a high frequency control signal even when the 
assumptions on the plant degree are correct. In Subsection 3.3.4 it is 
shown that in the presence of unmodeled dynamics, high frequency 
control signals will excite the unmodeled &yn;unics and cause ins- 
tability. The analysis provides a measure as to how large an input 
is necessary to produce instability given a certain configuration 
of the real plant with unmodeled dynamics. In addition, it is shown 
in Subsection 3.3.5 that, at values of the error loop gain which are 
considerably lower than those which ultimately cause instability 
the system parameters will be forced to move away from the values 
that provide good model matching in order to maintain stability. 

The analysis in Section 3.3 suggests that the stability problem ex- 
posed in Section 3.3.4 cam be remedied by normalizing the gain of the 
adaptation equations, making this gain inversely proportional to the 
square of the signals in the loop. The gain of the error system can 
then be designed independently of the size of the input. 
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This normalization is an integral part of algorithms CA3 
and CA4 . The analysis for these algorithms is contained in 
Section 3.5 and 3.6, The importance of the proper selection of 
the adaptation gains is reiterated during the analysis. Section 
3.4 deals with the algorithms CA2 which limits the gain of the 
error loop not by a direct normalization but by adding an inner 
loop to the error system. The function of this inner feedback is 
to place zeroes in the error transfer function and therefore to 
limit the bandwidth of the error loop. 

The analysis of all the continuous-time algorithms is demons- 
trated throughout Chapter 3 by use of a numerical example where 
the adaptive control system is designed using a first order model 
but the actual plant consists of an unmodeled pole pair in series 
with the nominal first order system. Digital computer simulations 
of the non-linear adaptive control system provide verification of 
the analysis. 

The message of the analysis of Chapter 3 can be summarized 
as follows: 

• Keep the gains of the adaptation mechanism low so 
that the bandwidth of the error system will remain 


small 
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The method of analysis developed in Chapter 3 provides for 
a given plant with unmodeled dynamics % a way to determine what 
gain will allow satisfactory response to constant inputs in the 
absence of disturbances. 

Chapter 4 provides insight into the response of the continuous- 
time algorithms in situations not covered by the analysis of Chapter 3. 
Particular attention is paid to the response to sinusoidal inputs 
and constant or sinusoidal disturbances. 

In Section 4.2, it is shown that pr ssent in each of the 
algorithms studied is an operator with unbounded gain. Such an 
operator will produce unbounded output signals in response to certain 
bounded input signals. Indeed, when the operator is presented with 
a sinusoidal input of constant amplitude, a component of the output 
will be a sinusoid of the same frequency whose amplitude linearly 
increases with time. 

It is also argued in Section 4.2 that not only is this infinite 
gain operator present in all seven algorithms considered in this 
work, but that such an operator is generic to all approaches to the 
adaptive control problem involving explicit or implicit identification. 

In Section 4.3 a heuristic argument is presented that the 
infinite gain operator can cause instability by two mechanisms. 



The first mechanism of instability is connected to the fact 
that, since the infinite gain opeiator is in a feedback loop, the 
increasing amplitude sinusoid at the output can be fed back to 
the input, thus compounding the problem. The result is a 
sinusoidal error signal which increases slowly in amplitude until 
the gain of the error system loop is increased beyond unity, at 
which point gross instability/ develops. 

The first mechanism will cause instability, only if a sinu- 
soidal signal develops at a frequency where the phase charac- 
teristics of the feedback loop defining the output and parameter 
errors cause reinforcement of the sinusoide at the input to 
the infinite gain operator. 

The second mechanism for instability is associated with a 
nonzero steady- state output error. A steady-state output error 
at any frequency, including constant errors, will, through the 
action of the infinite gain operator, cause the parameters to 
increase without bound. The parameters will eventually reach values 
for which the overall system with unmodeled dynamics is unstable. 

In Section 4.4, the following statement, conjectured to be 
true by the analytical argument of Section 4.3 is demonstrated to 
be true by digital simulations: 
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• In the presence of unmodeled dynamics, certain 
frequency reference inputs will cause the 
adaptive algorithms CA1-CA4 to become unstable. 

In Section 4.5, it is shown that the instability problems explained 
in Section 4.3 cannot be eliminated by such "fixes" as filters 
on the plant output or output error. 

In Section 4.6 the following statement, also conjectured 
to be true in Section 4.3, is verified as true by digital 
simulation: 

• A sinusoidal output disturbance at any frequency 
or a constant output disturbance will cause the 
adaptive systems CA1-CA4 to become unstable in 
the presence of unmodeled dynamics. 

Chapter 5 provides the same analysis for discrete-time algorithms, 
DAl to DA3, as Chapters3 and 4 provide for continuous- time algorithms. 
Indeed, the analysis is an exact parallel with all the principles 
learned in the continuous- time case carrying over to the discrete-time 
case. 

Section 5.1 provides the analysis of discrete-time algorithms 
under the conditions of constant reference input and no disturbances. 
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The analysis proceeds as in the contiguous- time case and proves 
just as insightful for design purpose:. Indeed, two more 
design "rules of thumb" become aparent in the analysis of 
Section 5.1. 

The analysis of Section 5.1.2 shows that the structure of the 
algorithm DA2 requires that there be a high feedback gain in the 
nominal control system. This leaves the algorithm unable to match 
the model and maintain stability in the presence of unmodeled 
dynamics. The algorithm DA3 is similar to DA2 except that it 
provides for extra filtering which makes it possible for the algo- 
rithm to match the model with feedback gains of any size. 

Therefore, this algorithm has ability to match the model in the 
presence of unmodeled dynamics. 

One must realize that situations such as those described in the 
preceding paragraph arise because all of the algorithm considered 
are designed on the basis of satisfying a single criterion, namely, 
to follow asymptotically a specified response to a reference input. 
It is up to the designer to assure that, if the algorithm converges, 
the nominal control system will be an adequate one with respect to 
rejecting disturbances and sensor noise and being able to function 
in the presence of unmodeled dynamics. Thus, the analysis has 
pointed out the following design rule: 


• design a good nominal control loop. 

Finally, the analysis of Section 5. 1.2, 3 shows that many of 
the problems connected with unmodeled dynamics are alleviated when 
the system is sampled slowly enough so t> at the poles and zeroes 
of the unmodeled dynamics essentially cai cel. Of course, it is 
well known that sampling systems too slowly results in jerky 
ste£> response and poor disturbance rejection. Thus, the last rule of 
thumb shown by the analysis on constant input systems is particular 
to discrete-time algorithms: 

• For good response in the presence of unmodeled 
dynamics, sample the system as slowly as other 
considerations will ali.ow. 

Section 5.2 demonstrates that there is a discrete- time equivalent to 
the infinite gain operator of continuous- time systems. That the 
opei ator leads to instabilities with certain high frequency inputs 
is demonstrated with simulations in Section 5.2.4. It is also shown, 
in Section 5.3, that this is another problem intimately connected 
with unmodeled dynamics and can be greatly alleviated by slow sampling. 

However, it is shown in Section 5.3 that a problem not alle- 
viated by slow sampling is the instability caused by a sinusoidal 
output disturbances. The residual error still drives the parameters 
to such a high bandwidth nominal control system, that any modeling 
errors will cause instability. This is shown in the analysis and si- 
mulations of Section 5.2.5. 

Chapter 6 provides the conclusions and possible direction for 
future research in the area. 
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CHAPTER 2 

INTRODUCTION TO ADAPTIVE CONTROL ALGORITHMS 


2.1 Introduction 

The purpose of this chapter is to provide an exposition of a number 
of algorithms which represent the state of the art in adaptive control 
and to set up the machinery necessary to analyze the performance of 
these algorithms in the presence of unmodeled dynamics. All of the 
algorithms considered have been proven to be globally asymptotically 
stable when the proper assumption? are realized. Each algorithm that is 
presented has been chosen because it displays particular characteristics 
when certain assumptions are relaxed. The various algorithms will be 
compared and contrasted in the sequel. The introduction of the algorithms 
will be divided into two parts,* the first will deal with continuous- time 
algorithms and the second will deal with discrete-time algorithms. 

The following notation will be used: 

Capital letters will represent system polynomials and lower case 
letters will represent time functions or constant gains. In particular, 

y(t) * — [x (t) ] 


will be used to indicate that y(t) is the output of a linear time- invariant 
system whose input is x(t) and whose transfer function is where 

A and B are polynomials in the Laplace transform variable s or the backward 
shift operator q" 1 . An underlined lower case letter will represent a 
vector of time functions or gains and an underlined capital letter will 
represent a matrix. 
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A superscript in parenthesis will be used to indicate the degree 

of £ polynomial, e.g., A^ U ' indicates that the polynomial A(s) has 

degree n. This notation will be used only when knowledge of the 

degree is important for the understanding of the point being made. 

,(m) 


The relative degree of the transfer function 


B 


(n) 


is the number 


of poles minus the number of zeroes, in this case, n-m. The relative 
degree will usually be denoted as n*. 

Discrete-time linear time-invariant systems will be represented 
in terms of the backwards shift operator q 1 , e.g.. 



y(t) 

_ (n) 

A 

(m) 

. ^ -1 

-2 

- l+b^q 

+ b 2 q 4 

(n) 

, -1 

-2 

= 1+a^q 

ta 2 q 4 


[x(t)J 


-m 


-n 


n 


ond d is the delay of the system. 


2.1,1 A Positive Real Primer 

Due to the importance of positive real systems in the adaptive 
control literature, this section summarizes pertinent results. The results 
for continuous-time systems are paralleled by the results for discrete- 


time systems. 
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Definition 1-1 I 59 ] A linear time- invariant system with transfer 
function H(s) is positive real, if H(s) has no poles with positive 
real parts, the poles of H(s) with zero real parts are single and have 
positive real residues and Re (h ( jfa)jj> 0 holds for all fa). The system is 
strictly positive real, if H(s-e) represents a positive real system for 
some real scalar e>0. 

A less formal statement of this definition can be given as 
follows : 

a positive real system is a stable system whose Nyquist 
diagram lies in the closed right half plane. 

The relative simplicity of maintaining stability in a feedback con- 
figuration, such as that shown in Figure 2-1, with a positive real 
system in the forward path and a linear time-invariant system in the 
feedback path is seen by considering the Nyquist criterion. The Nyquist 
criterion shows that such a feedback connection will be stable it the 
feedback path is itself positive real. Such a system would be stabilized 
by its phase properties independent of the size of the gain of the 
system. 

Note also that in order for v continuous system to be positive ref 1 
it must necessarily be of relativ . degree 0, 1, or -1. 

The phase properties of posi* ive real systems can be exploited 
further when the feedback system is time-varying by use of the following 


two lemmas. 


- 51 - 


v - ; * * •’ n J' ^ 

ORIGINAL PAGE 19 
OF POOR QUALITY 



l 

} 

i 

Figure 2-1. Feedback configuration with a positive real system 
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Lemma 1.1 : Popov's Ilyperstability Condition [60] 

The negative feedback interconnection, such as that of Figure 2-1, 
of a strictly positive real linear time- invariant system and a system 
whose input is y(t) and output is z(t) is asymptotically stable if 
y(t) and z(t) satisfy, for all t, 



y(x)z(x)dx > 


a 


2 


where l is a constant independent of t. Such feedback operators are 
called positive or passive. 

Note again that there is no upper bound limitation for the gain of 
the feedback operator if the passivity requirement is satisfied. 


Lem ma 1.2 : Kalman-Yacubovich Lemma [ 61 J 

If [A,b,c] is a minimal realization of a strictly positive real 

• ip 

transfer function, i.e., x(t) = Ax(t) + bu(t), y(t) = c x(t), 

T T 

then there exist matrices P=P > £, £=£ > 0. such that 

A T £ + P A = -£ (2-1) 

and 

P b = c (2-2) 

Lemma 1.2 is used to obtain Lyapunov functions for feedback 
configurations involving positive real operators. There is a generaliza- 
tion of this lemma to include positive real systems with relative degree 
zero but this generalization will lot be needed in the sequel. [61 ] 


The corresponding lemmas for discrete-time systems are exact 
parallels of the results for continuous time systems but are not 
needed in the sequel [ 62 ] . 

Note, however, that, in order for a discrete- time system 


, -d _ (m) , -1. 

««f q - ■ 1 

* (q > 


to be positive real, it must be stable and its 


-1 j0 

discrete Nyquist plot, i.e., the image c» ; H(q ), q=e , 0<8<2 tt, 
must remain in the closed right half plane. Since the magnitude of 
this plot does not go to zero except at z jroes of B(z *) , H(z "S must 
have the same number of poles as zeroes. This implies that the delay 


d must be zero. 


The above definitions and lemmas play vital roles in the published 
stability proofs of adaptive control algorithms. They '«ill be used in 
Section 2. 2. 1.5 to provide a sketch of one such stability proof. This 
sketch will demonstrate the importance of the assumption that the relative 
degree of the plant is known xn the stability proof. 
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2 . 2 Continuous Time Algorithms 

In this section, four continuous-time algorithms for adaptive 
control are introduced. The assumptions which are sufficient to 
prove global asymptotic stability are presented. The error system for 
each of the algorithms is developed. The error system provides a point 
of departure for the analysis of the various algorithms. 

In subsections 2. 2. 1.5 and 2.2.24 sketches of the key steps in the 
stability proofs of two of the algorithms are presented. These sketches 
serve the purpose of establishing the importance of the positive real 
condition in the stability proof. Since the satisfaction of a positive 
real condition is brought about by the assumption that the relative 
degree of the plant is known, a relaxation of the known relative degree 
assumption must make the retention of global asymptotic stability suspect. 

2.2.1 Continuous-Time Algorithm No.l (CAl) 

2. 2.1.1 Introduction 

The first algorithm, CAl, is the prototype model reference adaptive 
control algorithm. Its origins go back at least to Monopoli [ 26 ) . 

This algorithm has been proven asymptotically stable only for the case 
when the relative degree of the plant is unity. Hence, the algorithm 
will be considered only when a unity relative degree plant is nominally 
assumed. The algorithms published by Narendra and Valavani t 3 1 and 
Feuer and Morse I 4 3 reduce to CAl for the pertinent case. 




-55 


2. 2. 1.2 Assumptions 

Assume the plant is linear and time- invariant and is described 
by: 


_ (m) 
g B 

V t} “ _E rsrr 


lu(t)] 


(2-3) 


where A and B are unknown polynomials which satisfy the following 
assumptions: 

Al) Gain Sign Assumption? 

The sign of is known and, without loss of generality, is 
assumed positive. 

A2) Minimum Phase Assumption: 

B is monic and Hurwitz, i.e. its leading coefficient is 
unity and all zeroes of B(s) have negative real parts. 

A3) Relative Degree Assumption : 

A^ is of degree n and B^ is of degree m so that the 
relative degree n*=n-m is known. 

Assumption A3 can be relaxed to an assumption that an upper bound 
on the degree of A is known and that the relative degree of the plant is 
known exactly. However, in the present work, Assumption A3 will be 
used as is since the fundamental problems connected with the known 
relative degree assumption remain basically unaltered while the develop- 
ment is simpler with the more restrictive form of the assumption. We 
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also remark that much of the material of this dissertation is concerned 
with the behavior of adaptive control systems which are designed assuming 
that Assumption A3 holds when, in the presence of unmodeled dynamics, 
it does not; 


2. 2.1. 3 Controller Structure 

The structure for the adaptive controller CAl appears in 

Figure 2-2. The controller generates auxiliary signals y^t) from 

u(t) and Wy(t) from y(t) in the following manner: the i** 1 component 

of the vector w is 
— u 

i-1 

w. (t) - £u(t) | ; i=l,2,...n-l (2-4) 

ur p(n-i) 


where P ^ (s) is an (n-l) th degree monic Hurwitz polynomial and s 
is the Laplace transform variable. Similarly, 


i-l 

W . (t) = ~~7Z . . 


[y (t) ] ; r— 1,2,..., n 


The input to the plant, u(t), is 


(2-5) 


u (t) - k (t)r(t) + k T (t)w (t) + k T (t)w (t) (2-6) 

r — u -u — y y 

where k (t) is a time-varying gain, k (t) is an (n-1) vector of 
r ~u 

time-varying gains, k^(t) is an n vector of time-varying gains, and 
r(t) is the scalar reference input. 
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Figure 2-2. Controller structure for CA1 
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The object of the adaptive control, algorithm is to adjust the time- 
varying control gains in such a manner as to make tie actual plant 
output, y(t), match the output, y (t) , of a model driven by the 

r 

reference input, r(t). 


g B (m) 

V tJ - T?sr lr<t)3 


(2-7) 




where B^ is an m^ 1 order monic Hur^itz polynomial is an n** 1 

order monic Hurwitz polynomial, and g_. is a constant gain. 

r 

Furthermore, a joint requirement on and P^ n ^ has to be 

satisfied, i.e., that 


B^ m> divides P (n_1) (2-8) 

In the unity relative degree case, m=n-l and, therefore, 

B m » P (2-9) 

The reference model is chosen by the designer. It should be 
chosen in such a manner so that, if the controlled plant matches the 
model, the resulting controller has a large loop gain at low frequencies 
and a reasonable bandwidth. The choice of the model is a main element 
in the design of a control system which performs well at least 
asymptotically. 



* 
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Two composite vectors are now defined. 




_ m 

r(t) 


k (t) 

w (t) 

k(t) - 

k (t) 

— u 


— u 

w (t) 


k (t) 

~y 


L”Y J 


In this notation 

U (t) » k T (t)w(t) 
g B 

So, y (t) « lk T (t)w(t)] 


( 2 - 10 ) 

( 2 - 11 ) 


The description of the algoritlun is completed by specifying the 
control gain adjustment mechanism. 

k(t) » -t w(t)e(t) (2-12) 

where 

r a r > 0 is called the adaptation gain matrix, and 

e(t) » y(t) - y (t) (2-13) 

w 

is the output error. 

2. 2. 1.4 Error Equations 

It is often desirable to analyze the behavior of an algorithm with 
respect to a particular set of constant gains « In this subsection 
equations will be developed which relate the output error of eqn. (2-13) 


-60- 


ORIGINAL 
•; " OF POOR 

* * ' - * V'.,,* 

to the difference between the actual parameters and a nominal set of 
parameters. Let 

k(t) = k* + SUt) (2-14) 

where k* is a constant n vector. Substituting eqn. (2-14) in 
eqn. (2-11) , we obtain 


PAGE 19 
QUALITY 


y(t) - -E- Ik A w(t)+k (t)w(t))= [k* T w(t) ]+ Ik (t)w(t)J 


From the definitions of k and w, it follows that 


(2-15) 


k T w(t) = k* r(t) + k T w (t) + k T w (t) 
— — r ~u -u ~y -y 


(2-16) 


with the obvious correspondences. 
Define the polynomials 


*(n-2) . * n-2 ’ n-3 * 

K (s) = k . _.s + k . +...+ k . 

u u(n-l) \-.(n-2) ul 


(2-17) 


* . th * 

where k . is the i component of k , and 
ui — u 


*(n-l) . , * n-1 * n-2 

K (s) - k s + k . , x s + . 

y yn y(n-l) 


.+ k 


yi 


(2-18) 


* th * 

where k ^ is the i component of k^ . 
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Then, from eqn. (2-4) and eqn. (2-17) 


**(») 

k w(t) = -y : lu(t)] 

— u — P (s) 


(2-19) 


and from eqn. (2-5) and eqn. (2-18) 


*m K*(s) 

k w (t) = -2-— [y (t) ] 
-y -y P (s) 


( 2 - 20 ) 


Equation (2-15) can now be written as 


g B . K K g B 

y( t ) = -E- [k^ r(t)+ — — u(t) + y(t)l + Ik (t)w(t) 1 


or 


K* g BK g B * T 

y (t) = — - [y(t)l + P- - X- [y(t) ] + lk r r (t) + £ (t)w(t)] 


AP 


or 


y (t) = 


g B 

_E_ 

A 


K g BK* 

i_ X. 

J. T> 


j^k* r(t) + R^(t)w(t)J 


AP 


or 


k*g BP 

y<t) = AP-AK*-g BK* 

u p y 


k T (t)w(t) 


r (t) + 


g*B* 

* 

A 


[ k T (t)w(t) 

r( t) + — 

r 


( 2 - 21 ) 


( 2 - 22 ) 


where B* and A* are defined to be coprime with B* monic. 


i 
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Remark 1 ; q*B* is the closed-loop transfer function that would 
A* 

result if k_ were identically zero, i.e., if a constant control law 
k =* k* were used. 


Remark 2 : If the Assumption A3 holds and divides P (eqn. 2-8)^ 

then k* can be chosen, i.e., k*, k*, k* can be chosen, so that 

— r — u — y 


g»B* A 
A* 


k*g B (n) P <n - l) 
r p 




A <n) - g 

p y 



(2-23) 


Equation (2-23) is derived using the facts that, given the freedom 
of choice in k*, (p^ n ~^ - K** n_2 *) is an arbitrary monic (n-l) th 
order polynomial, is an arbitrary (n-1) order polynomial, 

and B (m) are coprime so that K * (n-1 ^ and K *< n_2) provide 2n-l 

degrees of freedom and hence the denominator is an arbitrary (2n-l) 
polynomial. By setting the denominator equal to *(” 

(remember, B„ divides P) , eqn. (2-23) follows. 

M 



Remark 3 ; If the Relative Degree Assumption (A3) is violated. 


9. B ■ can only get as close to 
A* 


% b m 


as the feedback structure of 


the controller allows. 
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The system error equations can now he derived in a particularly 
convenient form. Subtracting eqn. (2-7) from eqn. (2-22) yields: 


e(t) * y (t) - y*(t) 




Combining eqn. (2-12) with eqn. (2-14) gi /es 


k(t) = k* + K(t) - £(t) = -£ w(t»e(t) 


(2-25) 


In operator notation, one can write 


k(t) =| I[-I w(t)e(t)] (2-26) 

where — I_ denotes a diagonal transfer f motion matrix with each 
diagonal element equal to —• . 

The error system defined by eqns. (2-24) and (2-26) is represented 
in Figure 2-3. 

Table 2-1 summarizes the equations for CAl. 


2. 2. 1.5 Stability Analysis 

The feedback system of Figure 2-3 will be the object of much 
attention. Due to the dependence of w(t) on e(t), it is, in essence, 
a non-linear system. However, it can and will be viewed more simply 
as a linear time-varying feedback system as represented in Figure 2-3. 
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Plant 


Auxiliary 

Variables 


Model 


Input 

Output 

Error 

Parameter 
Adjustment Law 

Nominal Control- 
led Plant 


Error 

Equation 


TABLE 2-1 


EQUATIONS FOR CAl 


9 B 

y(t) * -~E- Iu(t)] 


i-l 


w . (t) = ~ 
ur P 


i-l 


w . (t) = “ 
yi P 


[u(t)J; i=l# 2, . . . ,n-l 


ly (t ) ] t i = lf 2 r m • • #n 


(2-3) 

(2-4) 

(2-5) 


* -1 

r(t) 


\ <t>" 

w (t) 

ll 

+J 

r 

k (t) 

-u 


— u 

w (t) 


k (t) 

|_"Y 


_-y J 


w(t) = 


y M (t) = ^ lr(t)] 

M *H 


(2-7) 


u (t) = k (t)w(t) 


e(t) = y (t) - y (t) 

M 


( 2 - 10 ) 

(2-13) 


k(t) = -r w(t)e (t) 


(2-12) 


g*B* 


k*g B P 

r P 

AP-AK. -g BK* 

u P y 


( 2 - 22 ) 


e(t) 


/a*B* g M B M \ a*B* T - T 


(2-24) 
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Z€ the plant order is properly modeled, i.e., assumption A3 
holds, and k* is chosen so that eqn. (2-23) holds, the following 
simplification occurs in Fig. 2-3: the driving term, e^ (t) in Figure 
2-3, is removed and the operator in the forward path becomes 



When the relative degree is unity (m=n-l), this simplification can 
be exploited to produce a stability proof, if the new forward path 
operator (equivalently, the model) is chosen to be strictly positive 
real. 

The resulting, simplified system is shown in Figure 2-4. This 
system can be proven stable by hyperstability (Lemma 1.1) because the 
feedback operator is positive [60). Note, however, that 
hyperstability arguments offer no "degree of stability" information and 
are not useful even if the Nyquist diagram forward path crosses into 
the left half plane only a snail distance at very high frequencies. 

To further demonstrate -:he fragility of the proofs of stability 
with respect to the positive realness of the forward operator, the 
proof of stability of CAl is presented next using the Kalman- Yakubovich 
Lemma (Lemma 1.2). Proofs o: this type for adaptive control systems 
were first provided by Parks [63]. This is the method also used by 
Monopoli [26 ] , Narendra and Valavani [ 3 1 , and Feuer and Morse 
[ 4 ] for this algorithm. 


-67- 


owgwm- pw* 


ts 


OF 


poor QUMirr 



Figure 2-4. Error system of CAT when Assumption 3 holds. 
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Let (A,b,c) be a minimal state space representation of the 

q B 
"mm 

strictly positive real transfer function with input u, state 

K r M 

x and output e. Let P, £ be as in Lemma 1.2 for this system. Then 


V(x,K) = x T P x + jc T r 1 k 


(2-27) 


is a Lyapunov function with 

V(x,k) = x T (A T P+P A)x + 2x T P t K T w - 2k T w e (2-28) 

T T ~T ~T 

“ 2 . + 2x £ k w - 2k w e (2-29) 

= -x T £ x < 0 (2-30) 

where the second equality makes use of eqns. (2-1) and (2-2) and 

T 

the third equality uses c x = e. This Lyapunov analysis proves that 

e and k are bounded. With some additional analysis in this case it 

has been shown that lim e(t)=0. 

t-w» 

The point to note here is thct eqn. (1-2) is used to exactly 
cancel two terms of unknown size end sign in the Lyapunov function 
derivative. Therefore, no notion of "almost" positive real such as 
if eqn. (2-1) were replaced by 


P b = £ + 8 (2-31) 

where e is small would be of any ise. Such use of a property with 
such dubious physical realizability as positive realness must at 
least make one suspect the practicality of the results. 



In chapter 3, the properties of CA1 and other algorithms, when 
assumption A3 and, therefore, positive realness of the error equation 
are violated, will be investigated more directly. 

2.2.2 Continuous-Time Algorithm No. 2 (Cl 2) 

2. 2. 2.1 Introduction 

The algorithm CA2 maintains the same basic structure as CA1 but 
uses a different adjustment mechanism in order to prove stability 
when the relative degree of the plant is greater than one. This 
algorithm was published concurrently by Narendra, Lin, and Valavarii 
I 5 ] and Morse [ 6 ] . In [ 6 ] this algorithm represents the first 

of the two algorithms considered. The second algorithm in [ 6 ] will . 
be analyzed as CA3. 

There are two differences between CAL and CA2. Firjt, in order 
to achieve a positive real error operator when the relative degree of 
the plant is greater than one, auxiliary signals are added to the error 
signal used in the adjustment mechanism. Second, another term is 
added to the error signal in all cases. At first glance, the purpose 
of this term appears to be the satisfaction of a technical condition for 
proof of stability; however, it will be shown in section 3.4 that this 
term does actually improve stability characteristics. 


2 . 2 . 2 . 2 Controller Structure 


The structure for the controller in CA2 is shown in Figure 2-5. 
Much of the structure is inherited from CAl. In particular, eqns. 
(2-2) -(2-24) apply with the exception of eqn. (2-12) which defines 
the adjustment mechanism. Assumptions A1-A3 of Section 2. 2. 1.2 are 
also needed for the stability proof of CA2. 

In order to achieve a positive real operator in the error system 
when the relative degree of the plant is greater than unity, auxiliary 
filters not present in CAl must be defined. 

Assume that the plant has relative degree 


n* = n-m > 1 


(2-32) 


Then there exists integer p and polynomials and 

(p+n*-l) . 

■ so that 


(p+n*-l) (m) 

y M M 


m (p) a w 


(2-33) 


is a desired positive real transfer function. In Morse £ 6 ], the 


desired function is chosen as 


s+A ‘ 
o 


Note that the degrees of the 
M 


polynomials are such that — is not proper but ~ and the entire 

n lj 


transfer function (2-33) are. 
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Figure 2 - 5 . Controller structure for CA2. 


! 







-72- 


ORIGINAL PA® « 
OF POOR QUALITY 


To the equations (2-2)- (2-11) and (2-13)- (2-24) held over from 
CAl the following are appended. 

v(t) = | I tw(t)] (2-34) 

M M 

where — denotes a diagonal matrix of transfer functions — 

Xj Jj 

as in eqn. (2-26) . Also define 



z(t) 

A M T . . , . . 

= 7 Ik (t)w(t)] 

ii 

(2-35) 


t) 

A T 

» z(t) - k (t)v(t> 

(2-36) 


y (t) 
J a. 

“ MA f“h(t)^(t)- pv (t)£ v(t)e(t)l 
M L J 

(2-37) 

where 

e(t) 

= e(t) + y (t) 

cl 

(2-38) 


h(t) is a time-varying gain and p is a fixed positive constant. 

The adjustment law now is 

K(t) = -£ V(t)€(t) (2-39) 

h(t) = yt|j(t)e(t) (2-40) 

where y is a fixed positive const mt. 

2. 2. 2. 3 Error Equations 

The error system for this algorithm is now developed. Use, as 
before, 

k(t) = k* + K(t) (2-14) 
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with eqns. (2-34) to (2-38) to <jet 


, . . M 
\|»(t) * “ 


k T (t)w(t) 


- k T (t) £ Ilw(t)] 


a M 
* L 

k* T „ ( t) 

*5 

jc T (t)w(t) 


r 

1 



- k* T £ I(w(t)l - ic T (t) - I[w(t)J 

— L ~ i, — — 


= ^| k T (t)w(t) 


“ |i T (t)w 


(t) 


- k T (t) £ I[w{t)] 


.T 


- ic (t)v(t) 


(2-41) 


The block diagram for the error system is given in Figure 2-6 
where the forvexd operator is taken from eqn. (2-24) and the 
adjustment rule for h is omitted. 

Let 

h(t) - h* + h(t) (2-42) 


then 


e(t) 


y (t) + e (t) = j-h*\j;(t)-h(t)^(t)-pv (t)£ v(t)€(t) 

a 


'm m r . 

“St L 

(t)w(t)] + - -jp) [*<«] 


>] 


Substituting eqn. (2-41) for ip in the first term yields 


e<t> ■ ' ~i Ui ) [ iT|t, - (t) ] + [* T<t, * (t) ] 

+ 9 ^” L - [-h(t)i|)(t)-pv T (t)r»<t)e(t)J+ 


(2-43) 
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Figure 2-6. Er*or system for CA2. 
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A diagram for this way of representing the error equations is 

shown in Figure 2-7. Again the "equation for adjusting h is 

J jt' * 

omitted as is also the generation of 

The equations for CA2 are summarized in Table 2.2. 

2. 2. 2. 4 Stability Analysis 

Clearly the error system of Figure 2-7 is still a very complex 
system. Some simplifying assumptions will be made in order to 
better understand how the system is behaving. Consider first the 
situation where the plant is modeled correctly, i.e. assumption A3 
of Section 2.22.2 is satisfied. Pick k* so that eqn. (2-23) is 

satisfied and pick h* = so that the first term and the last term 

r 

in eqn. (2-43) vanish. Then 


€(t) » 


Since 


h *W f.-T 

V 

h *w 


tin,!,/.) PS (t)]l v(t)e(t) 
k‘(t)v(t) - =^r 


(2-44) 


V 


is strictly positive real, the Kalman-Yakubovich 


Lemma can again be used in a Lyapunov analysis. Let (A,b,£) be a 
minimal realization of M with state variable x and let 

V 


P and £ be as in Lemma 1.2. Then, using eqns. (2-39) and (2-40) 
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TABLE 2-2 


EQUATIONS FOR CA2 


9 B 

y(t) = Iu(t>] 
i-1 

w . (t) «■ | [u(t)]j i“l,2, . . . ,n-l 

UJL P 

i-1 

w . (t) Iy(t)]y i-1, 2, , * #n 

yx P 


'r(t) “ 


\(tf 

w (t) 

k(t) 

k (t) 

“U 

w (t) 

-y 

u 

k (t) 

y 


v(t) = ~ l[w(t)] 

li 

z(t)=| Iw T (t)k(t)J 
ip(t) = z(t) - k T (t)v(t) 

V*> - & ..(«,! 

u(t) = k T (t)w(t) 


* y(t) - y M <t) 


(2-3) 

(2-4) 

(2-5) 

(2-34) 

(2-35) ’ 
(2-36) 

(2-7) 

( 2 - 10 ) 

(2-13) 


Output Error 


e(t) 
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TABLE 2-2 CONT. 


Augmented 

€(t) « 

e(t) + y (t) 

(2-38) 

Error 


oL 



Lg B 

y ct) ■ i-h(t)i|)(t>-pv T (t)r v(t)e(tn 

a ~ 

(2-37) 

Parameter 

k(t) * 

-£ v(t)e(t) 

(2-39) 

Adjustment Law 





h(t) « 


(2-40) 

Nominal Control- 

g*B* 

k*g B P 
r y p 

(2-22) 

led Plant 

A* 

AP-AK*-g BK* 


u p y 


Error 

Equation 


+ 



h \ m ti ~T 

1 t* (t)v(t) 


h V M 




]+ 


w 

V 


^ lk T (t)w(t)J 

[-h(t)i|){t)-pv T (t)£ v(t)e(t) ] 
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is a Lyapunov fvmction with 

V (x,k) = x T (^ T p+pa)x t x T Pb k T v-fiile ' P - ~ - - 

h* h* 

-T 

- e k v + e hip 

h* 

= -x T Q x - £* 6 2 v^T V £ 0 (2-46) 

which proves that k(t) and e(t) are bounded. Note, however, that 
now e(t) being bounded does not itself ensure that y(t) is bounded. 

The proof that y is bounded is very involved and is performed in 
15] and [ 6 ], where it is also proved that lim e(t)=0. 

t“K» 


2 . 2 . 2 . 5 A Special Case (n*=l) 

When the relative degree of the plant, n*, equals one the 
algorithm CA2 simplifies greatly. In this case, let 


k M B M L 

be positive real and let — be the identity operator, which 

M " 

results in w=v and i]i=0. Then eqn. (2-43) becomes 


• (t) = ji T (t)w(t)J - — p ^pw T (t)r W(t)e(t)j 

•(*¥-- ^)H 


(2-47) 


This error system for the case n*=l is shown in Figure 2-8. 


I 
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g* b*(s) 



kf A*(s) 



pdlii 


L 


^ / 


Am( s ) 



n 


/»s T (t)rs(t) 



rw(t) 


Figure 2-8. Error system for CA2 when n -1. 
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It can be seen from Figure 2-8 that the only difference 
between the error systems for CAl (see Figure 2-3) and CA2 is the 
added inner feedback loop in CA2. Although this loop was added for 
technical reasons regarding the stability proof it will be seen in 
Section 3.4 that the added loop does in general improve stability 

properties . 

The equations for CA2 in the case where the relative degree of 
the plant is unity are summarized in Table 2.3, 

2.2.3 Continuous-Time Algorithm No. 3 (CA3) 

Algorithm CA3 is very similar to algorithm CA2. The major dif- 

L 9 M B M L 

ference is that, in CA3, — is picked so that is a 

M AM 

M 

M 

memoryless system and — has unity d.c. gain. If M is of order p, 

Xj 

L must now be of order p+n* instead of p+n*-l as it v'as in CA2. This 

T 

change causes other small changes. The term pv £ v e is no longer an 
input to the equations generating y so eqn, (2-37) is replaced by 

cl 

9 B L p t 

y a (t) = if" [-h(t)i|»(t)J =< - g o h(t)i//(t) (2-48) 

M 

where g is the dc gain of the model. 

The quadratic expression does, however, appear as a normalizing 
term in the parameter adjustment equations. Specifically, eqs. (2-39) 


and (2-40) become 
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TABLE 2-3 

EQUATIONS FOl't CA2 WITH n*-l and L=M 

g B 

Plant y (t) = -j» — £u(t)] 


(2-3) 


i-1 

Auxiliary w . (t) = ~ lu(t)]; i=l,2, , . . ,n-l (2-4) 

Variables U1 

i-1 

w .(t) = — ly (t) ) ; i=l , 2 , . . . , n (2-5) 

yi ir 


Model 


~r (t) " 


k <tf 
r 

iw (t) 

i k(t) 

k (t) 

— u 


~-u 

w (t) 


k (t) 

-y 


~y 


^M (t) " 


9 m b m 


Ir (t) ] 


(2-7) 


Input 

u(t) = k T (t)w(t) 

(2-10) 

Output Error 

e (t) « y(t) - y (t) 

M 

(2-13) 

Augmented 

e(t) = e(t) + y (t) 

(2-38) 

Error 

u 



9 B 

y (t) - [-pw T (t)r w(t)€(t)) 

a a m 

(2-37) 

Parameter 
Adjustment Law 

k(t) = -r w(t)e(t) 

(2-39) 


I 
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TABLE 2-3 CX NT. 


lominal Controlled 
Plant 


9*tt* » 
A* 


k*g « P 
OL. 

AP-AKj-fjj fttF 


(2~TJt) 


Error Equations 


€(t) 


jjijp tlf{t)v(tn- ™ [p S V>[i(k)e(t)) 



Vm\ 


tr(t)J 


(2-4?) 
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■m * 


* * « 


f* 


■rv(t)e(t) 

|(t) * = (2-49) 

X o + V (t)T v(t) 

h - - (2-50) 

V i <t>r v (t) 

where X is a positive constant, 
o 

The proof of stability for this algorithm is given by Morse 
* 

[6 ] . The effect on the error system of the changes made by 
Morse is shown in Figure 2-9 which is the parallel of Figure 2-7 for 
CA2. Note that no simplification occurs for the case n*=l because, 

M 

in CA3, — must still have relative degree one when the plant 
Xj 

does. 

It will be seen in Section 3.5 that the normalization of the 
error in the parameter adjustment mechanism results in an important 
improvement of the system's response to constant inputs in the presence 
of unmodeled dynamics. 

The equations for CA3 are summarized in Table 2.4. 


In [ 61, Morse proves stability of this algorithm with Ij=r ' . The 
version with both JT and IT 1 positive definite matrices allows more 
flexibility while Morse's proof holds mutatis mutandis . 


X+vT(t)r'y(t) 


Figure 2-9. Error system for CA3. 
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TABLE 2-4 
EQUATIONS FOR CA3 
g B 

y(t) = — Iu(t)J (2-3) 


w . (t) a 5 

U1 P 

(t) j } i = l 1 2 f • • • § n-1 

(2-4) 

i-1 

"yi (t) " P 

ly (t) ] ; i=i,2,... f n 

(2-5) 


’r(t) ' 


1 

*• 

-j 

«+ 

i u (t) 

*9 

1* 

ft 

II 

k (t) 
— u 

V* (t) 


k (t) 



~y 

im mm 


V(t) = | I [w(t) ] 

(2-34) 

z(t) = 7 Iw T (t)k(t)] 

(2-35) 

i|i(t) = z(t) - k T (t)v(t) 

(2-36) 

y M (t) = ^ Ir (t) ] 
M *M 

(2-7) 

u(t) = k T (t)w(t) 

(2-10) 

e(t) = y (t) - y (t) 

M 

(2-13) 

e(t) = e(t) + y m (t) 

(2-38) 

y a (t) = -g Q h(t)iji(t) 

(2-48) 

Vm, 

9 ° ' 1,0 
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2.2.4 Continuous-Time Algorithm No. 4 (CM) 

2. 2.4.1 Introduction 

The algorithm that will be referred to as CA4 is representative 
of the class of algorithms developed by Egardt [ 11 ] . It differs 
from the preceding algorithms in that it prefilters the reference 
input and then uses extra filtering in the control loop to convert 
the controlled plant into a memoryless system. The system is shown 
in Figure 2-10. 

This algorithm is of interest because it provides a continuous 
time analogy to many popular discrete-time adaptive control algorithms. 
Also, this algorithm provides the designer with a simple yet flexible 
controller structure with which to work. 

2. 2. 4. 2 Controller Structure 

The plant is the same as in the other algorithms and nominally 
has relative degree n*»n-m. As before, 



The auxiliary signals, v(t) , are generated by a method similar to 
the method used in the other algorithms except that the signals y(t) 
and u(t) are first filtered before entering the auxiliary signal 
generators and the reference input is filtered by the reference model 
before being used. 
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The equations corresponding to eqrs. (2-4) and (2-5) are; 

x 

g l-l r -j 

W ui (t) = (n-1) (n*) [ u(t) J i*!' 2 ' /«-l 

P L 

W ui (t> = p (n-l) L (n*) [ y(t) ] i*l#2, . . . ,n 

w r (t) = y M (t) = [r(t)] 


(2-5;:) 


(2-54) 


(2-55) 


The input, u(t) , to the plant is formed by; 

u(t) = L* n * ^ (t)w(t)J (2-5(.) 

where k is the vector of time-vary ng gains and w is the vector of 

auxiliary signals formed from w , w , and w as was done in the 

r — u — y 

other algorithms. In CA4 the gain ;, k, are not adjusted directly but 
are generated from other adjustable parameters, f, by 

Z 

k(t) = I I£<t)J (2-57) 

th ■ 

where A(s) is an (n*-l) order polynomial in s and SL is chosen so 

that _o has unity d.c. gain. The parameters f are adjusted by ;he 

A 

equation 


f (t) 


w(t)6(t) 


(2-58) 
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where 

€(t) * e(t) + y (t) (2-59) 

cl 

and X q Is a positive constant. The auxiliary output in this 
algorithm is simply 


y a <t) = h(t)(k T (t)-f T (t)) w(t) = h(t) (E T (t)-f T (t))w(t) (2-60) 

where h(t) is a time-varying gain which is adjusted according to 
the following mechanism 


h(t) = 


(k T (t)-f T (t))w(t)e(t) 

X +w T (t)w(t) 
o — — 


(2-61) 


2. 2. 4. 3 Realization Issues 

A few words must be said about the realiz.ibility of eqn. (2-56). 
This equation cannot be realized directly since it requires n* 
differentiations. Note, however, that an indirect realization is 
possible since one has available n* derivatives of w(t) through 
its generation (eqns. (2-53) -(2-55)) and n* derivatives of k(t) through 
its generation (eqns. (2-57) and (2-58)). In fact, this realizability 
constraint is the raison d'etre for eqn. (2-57) and the generation of 
y a (t). 
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2. 2.4.4 Error Equations 

By following the same procedure as in Section 2. 2. 1.4, K* 
and K* are again defined as in eqns. (2-17) and (2-18) and the 
following equations corresponding to eqns. (2-21) and (2-22) are 
hence developed: 


y(t) 


g BK* 

P y 


V 


( k g BLF 
r*P 

(P-K*)A- 


~)[ r(t> ] + k r J? 


+ K T (t)w(t) 

r 


(2-62) 


(2-63) 


g*B* 

For this algor ithm, the objective is to make ? -- y , the nominal 

«» 

closed loop system equal to a constant gain rather than equal to 


9 m b m 

a m 


It can be seen from the pclynomial orders in eqn. (2-62) 


repeated below 


k*g B <»> L <n-m) p (n-l) 
...x.JL 


( n -D. K *(n-2) (n> (m) K *(n-l) 

u p y 


that the extra filtering of L(s) makes this possible. When the system 
is properly modeled the error equations can be represented as: 


e(t) - K T (t)w(t) 
r 


(2-64) 
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The stability analysis uses the same assumptions as the other 
algorithms (A1-A3) from Section 2. 2. 1.2 end 1 the proof of global 
asymptotic stability follows from the use of the Lyapunov function 

V(f,h) = f T f + h 2 (2-65) 

The analysis required, after the initial Lyapunov analysis establishes 

bounded feedback gains, is more involved than the ether algorithms 

but the proof outline follows some more intuitive concepts. 

In [ llJ , Egardt shows that a large output error leads to large inputs 

which improves identification. With improved .identification, the 

controlled plant will converge to the desired reference model. 

The error system when the Relative Degree Assumption (A3) is 

violated is displayed in Figure 2-11. 

Notice that when n*=*l and tL=l , the error system reduces 

o 

to that cf Figure 2-12. The equations for CA4 are summarized in 
Table 2-5, and, for the case where the relative degree of the plant is 
unity, in Table 2-6. 

2. 2. -1.5 Comments on Problem Formulation 

The controller structure of CA4 graphically demonstrates possible 
shortcoming of all the algorithms of adaptive control theory which aim 
only at achieving certain closed- loop response characteristics for 
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Figure 2-12. Error system for CA4 when n*=1. 
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PARS 


TABLE 2-5 


EQUATIONS FOR CA4 
9 B 

y(t) = Iu(t)] (2-3) 


i-1 

s 


W . (t) 
Ul 

s 

PL 

Iu(t)J; 

1=1 f 2 / m • m f D" 1 

(2-53) 


i-1 




w , (t) 
yi 

s 

PL 

ly (t) ] ; 

1=1 f 2, • • • f n 

(2-54) 

w r (t) 

9 B 

_ M M 
A.. 

fr(t)] 


(2-55) 


M 



w r <tf 


\(t)“ 

w(t) * 

w (t) 

? k(t) 

k (t) 

— u 

w (t) 

-y 

-u 

k (t) 

—17 


9 B 

y M (t) = Ir(t)1 (2-7) 

u(t) = L[k T (t)w(t)] (2-56) 

e(t) = y(t) - y M (t) (2-13) 

e(t) ® e(t) + y (t) 

a 


Augmented Error 


(2-59) 
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TABLE 2-6 

w*—— iw i m i ii m >ii vm nr y ** n * » w » 


EQUATIONS FOR CM with n*«l 
g B 

y(t) * -£-* tu(t) J 
s^ 1 

^ ui (t) * “~^£T t»(t))i i«l,,».»n-l 
i-1 

w yi (t) “ [y (t) 1 1 i«l,2 n 

v<t>*» [t{t)] 
r % 



\t«" 



W<t) ** 

w ,(t) 
— u 

< £(t) 

*u (t > 


W (t) 


k (t) 


~Y 


-y 


y M (t) * tr(t)) 

M Ay. 


u(t) « L[k r (t)w(t)J 
e(t) “ y(t) - y M (t) 


<2-3) 


<2-53) 


<2-54) 


(2-55) 


(2-7) 


(2-56) 


(2-13) 


k(t) * 


-w(t)a(t) 

r fcmfnw* niiifcMiwaw 

X 0 +w T (t)w(U) 


iV v 

)r <P-K*)A-g BK* 

u *p y 


(2-57), (2-58) 


(2-63) 


^sfr f£ l (t)w(t)] + fyr- -i) Iy M <t> 3 


Error Equation 


(2-67) 
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tra;king reference inputs. Input tracking is a problem which can be 
solved without feedback if the plant is known, tiy filtering the 

i 

reference input with the desired closed-loop transfer function, the 
controller nay be able to achieve model matching with very small 
feedback gain. Indeed if L of egnsu (2-53) , (2-54) and (2-56) can be 
chosen as the inverse of the plant, the nominal control gains k* will 
be aero. While a low gain controller may be desirable in an adaptive 
setting due to its stability robustness, it is clearly not a "good” 
controller in that it will not perform well the fundamental feedback 
control function of disturbance rejection. Since the results on 
adaptive control come mainly from a problem formulation involving only 
tracking properties much "engineering judgement" must be applied when 
attempting to use these systems for the usual jobs of feedback control 
such as disturbance and sensor noise rejection. The results of this 
thesis provide insight to form the basis of this engineering judgement 
for adaptive control systems. 
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2.3 Pi aerate- Time Algorithm 

2.3.1 Introduction 

In this section , three algorithms which perform adaptive control 
for discrete-time systems are introduced. All of the algorithms 
considered have been proven in the published literature to be 
globally asymptotically stable when the assumptions of the following 
subsection are satisfied. These assumptions are exactly analogous 
to the assumptions used in the continuous- time algorithms. 

2.3. 1.1 Model and Assumptions 
Assume the plant is described by 

3 <f d B tn) 

y (t) « JE — tu(t)] (2-67) 

. (n) 

A 

where 

B (m) « l'fb.q - ^' +...+ b q’ w (2-68) 

1 m 

A^ ** 1+a^q ^ a^q n (2-69) 

< —1 
and q x is the backward shift operator, i.e. , q [u(t)l * u(t-l). 

The assumptions used in the stability proofs of the adaptive 

control algorithms are: 

Ai) Known Sign of Gain Assumption 

The sign of g is known and, without loss of generality, 

P 

positive. 




- 101 - 


A2> Nonminimum Phase Assumption 

All the zeroes of B have magnitude less than one. 

A3) Known Pole-Zero Numbers 

The delay, d, in eqn. (2-67) is known as are the degrees 
of B and A, m and n respectively. 

The assumption on knowing m and n can be relaxed to knowing an 
upper bound for m and n, but the delay, d, must be known exactly. 

Knowing the delay is equivalent to knowing the relative degree of 
the discrete-time transfer function since the delay is equal to the 
number of poles minus the number of zeroes of the transfer function. 
Assumption A3 will be used as is in the sequel since, in order to 
take advantage of the relaxed version of the assumption, the adaptive 
system must be built as if m and n were equal to their upper bounds. 

The conceptual idea of using a positive real condition to obtain 
Lyapunov stability proofs of these algorithms is the same as in the 
continuous-time algorithms and will not be treated here. 

What will be treated in Chapter 5, however, is the behavior of the 
algorithms when Assumptions A3 and A2 are violated. 

2.3.2 Discrete-Time Algorithm No. 1 (DAI ) 

The algorithm DAI is the discrete-time counterpart of the continuous- 
time algorithm CA2. It was introduced by Narendra and Lin [7] . 
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2 . 3 . 2 . 1 Controller Structure 

The structure of the controller is exactly analogous to the 
structure of CA2 given in Figure 2-5. The plant is described by 
eqn. (2-67). The system will be designed assuming d>l and n are 
known and m=n-d. The model is given by 

g q _d B < n “ d > 

y M (t) = ~ ^ lr(t)l (2-68) 


QUAUTf 


as shown in Figure 2-13. Th « auxiliary variables are generated by 


- (i+1) 

w „ (t) = > -■ u(t) ; i=0, 1, . . . ,n-2 

ur in-1) 


(2-69) 


-i 


w .( t ) - ~ ^ n - l ) y(t) f i * 0 * 1 /--* 11 - 1 
P 


_(n-d) , . . , _(n-l) 

B' divides P 

M 


where 

The scalar control input to the plant is: 


(2-70) 


(2-71) 


u(t) = k (t)w(t) (2-72) 

where k(t) is a vector of adjustable gains. The definitions of 
k(t) and w(t) are as usual throughout this work r repeated in eqn. (2-73) . 


k (t) - 


\<tf 


”r (t) " 

k (t) 

w(t) = 

w (t) 

— u 


— u 

k (t) 


w (t) 

-y 


_-y 


(2-73) 
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The output error is 


e(t) » y (t) “ y M (t) 

As in CA2 # auxiliary signals are fed back into the model. These 
signals are generatedusing the filter 


(2-74) 


q~ d M*** 
, (k+d) 


(2-75) 


which is chosen so that 


!,(**» B « n ~ d) 
« <W A™ 


M 


is strictly positive real an L that — has unity d.c. gain. The 

L 

auxiliary signals are generat'd by: 


(2-76) 


a“ d 

v(t) * Hssr 

L 


(2-77) 


cf d M (1C) T 

Z(t> " ~ ( k +d)" IS (t)w(t)J 

L 


(2-78) 


^(t) s z(t) - k (t)v(t) 

B (n-d) (k+d) 
y (t) = M M L 


T 


. (n) (k) 

\ M 


(2-79) 


[-h (t)^» ( t) -v ( t) IV (t) € (t) ] (2-80) 


where h(t) is a time varying gain. 
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The parameter adjustment is performed by letting 


e(t) = 

e(t) + y (t) 

cl 

(2-81) 


-1 


k(t) = k 
— — o 

- 3 — r ir v(t)e(t)i 

l-q 

(2-82) 


-1 


h(t) = h 

o 

+ — InJ>(t)e(t)J 

4 

(2-83) 


i-q 


where T and y axe the constant adaptation gains. 


2. 3. 2. 2 Error Equations 

As was done with CA2 the system will be analyzed with respect 
to a nominal parameter set (k*,h*) with 


k (t) = k* + k (t) 
h(t) = h* + h(t) 


The error equation is derived to be: 


e(t> 


' r \ 


^ n) M <k > 


[k T (t)v(t)J 


(n-d) (k+d) 

g M B M L 

a (n) (k) 

M 

-d 


[ -h(t)^(t)-pv T (t)rv(t)€(t)J 


( -d -d (n-d) v 

g*q P B* g K q B M ] 
A* - ^n) ) 


[r (t) ] 


(2-84) 

(2-85) 


( 2 - 86 ) 
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where the nominal controlled plant is now: 


-d 

*_ P n* 

g q b 


-d 

i * p 

k g q * 


B P 


(n-1) 


A(P (n " 1) -q _1 K* (n " 2) )-g q’ dp BK* (n_S ' 
u P y 


In the preceeding equations the following notation was adopted: 


(2-87) 


dp is the actual delay of the plant 


K* = k* + k*.q'” 1 +...+ k 


yo 


y! 


y (n-1) 


* = v * + k* q” 1 +...4 k* 


K" = k 
u uo 


- (n-1) 


- (n-2) 


ul 


u(n-2) 


A sufficient number of degrees of freedom have been left so 
that, if the plant is modeled correctly, the parameters can be 
chosen so that 

-d -d n 

g*q P B* M 


( 2 - 88 ) 

(2-89) 

(2-90) 


(2-91) 


i.e., there exists a set of constant feedback parameters for which 
the controlled plant matches the model exactly. 

The stability proof proceeds using the discrete-time version of 
the Kalman- Yakubovich Lemma (see [7,62] ) . Whether the plant is 
properly modeled or not the error system loop is closed by the adaptation 
mechanism: 


-1 


K(t) = L - 


i-q 

-l 


rj- [rv(t)e(t)i 


h(t) = h - [Y^(t)e(t)l 

i-q 


(2-91) 


(2-92) 



A diagram of the error system ie shown in Figure 2-14. It is an 

, . y * ■ * 

• *r f ... 

exact counterpart of Figure 2-7. The eqaatidriSv £or?'DAl are summarized 
in Table 2-7. 

2.3.3 Discrete-Time Algorithm No, 2 (DA2) 

The algorithm introduced here as DA2 is the algorithm developed 
by Goodwin, Ramadge and Caines [ 10 ] . It is the simplest of all the 
algorithms both in structure and in the proof of stability. 


2. 3. 3.1 Controller Structure 

The structure of the controller for DA2 is given in Figure 2-15. 

The actual plant is represented by the equation: 

-d 

p 

9 r q r B 

y (t) = — [u(t)3 

and the reference model is given by: 


g M q " d B u m> 

Ir(t)1 


(2-93) 


V 


The system is designed assuming d^d and the degrees of B and A 
are m and n respectively. 

Auxiliary variables are generated simply by delayed versions 


of the input and output variables, as follows: 


108 - 


r(t) 



Figure 2-14. Error system for DAI. 
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Plant 


Auxiliary 

Variables 


Modi'l 
Inf ut 

Output Error 


TABLE 2-7 


EQUATIONS FOR 1JA1 
-d 

9 q P 

y(t) " [u(t)l 


-(i^l) 

w u ^(t) " twit)] , i"0#l# . . . »n-2 

-i 

w yi (t) « (y(t)3> i**0,lt •• *#«-! 


w(t) * 


— d 

V (t) « I [w (t) ) 

— It — — 

-d 

a(t) «_SL^ t jc T (fe) „ (t)J 


>|>(t) « «(t) - k T (t)v(fc) 


g M q" d B M 

y^(t) » — — — -^tr(t)) 


■*<t) ■ 


r 

M*> 

jK. 


I k(t) ■* 

v-> 

w (t) 


k (t) 



"7 


M 


T, 


u(t) * k (t)w(t) 
e(t) * y(t) - y M (t) 


(2-67) 

(2-69) 

(2-70) 

(2-73) 

(2-77) 

(2-70) 

(2-79) 

(2-60) 

(2-72) 

(2-74) 
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TABLE 2-7 CONT. 


Auxiliary Error 


e(t) = e(t) + y (t) (2-81) 

A 

W T • 

y a ( t) 58 jji l-h(t)|(t)-pv (t)r v(t)e<t)l ( 2 - 80 ) 


Parameter 
Adjustment Law 


-1 


k(t) = k - — . [r v(t)e(t)I 

— ■— O - -l 

1-q 


(2-82) 


-1 


h(t) = h + . lY'Mt)e(t)l 

O - "1 

i-q 


(2-83) 


Nominal Controlled 
Plant 


• -d 

9* 3 JL B * a 

A" 


-d 

k*g q ^ 

JLE. 


BP 


(P-q "^K*) A-cf q 

u p y 




B 


(2-87) 


Error Equation 


e(t) 


/ * " d p h*g q‘ d B (n-d) \ 

B ( sLa -Ja? _m ) [K T (t )w 

V kjA* ^n) / (t)w 

h vr ,i(kwl t 


(t)l 


_ (n-d) (k+d) 

g b C< 

y M M 


T . 


, <n) 
a m m 


J£y I-h(t)^(t)-pV A (t)rV(t)€(t)3 


( -d 


-d 


P A*. V . B M n " 




d,\ 

- yir(t)] . 


(2-86) 
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i i 

i 


tfeVV^p 

Figure 2-15. Controller structure for DA2. A (Q ) 
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W yi (t) 

= q i Iy(t)] i-0,1,.. . ,n-l 

, . . , a • 

it r * ‘ » ♦ r ' 

(2-94) 

W ui (t) 

= q" <i+1> tu(t)] i*0,l, . . . ,n-2 

(2-95) 

w r (t) 

g B <m) 

" . (n) Ir(t)1 

(2-96) 


Sl 


The scalar control input to the plant is: 

u(t) = h T (t)w(t) (2-97) 

with k(t) being a vector of time-varying gains and the usual 
definitions for k(t) and w(t) pertaining. 


'k (t)" 


w (t) 

r 


r 

k (t) 

w(t) * 

w (t) 

— u 


-u 

k (t) 


w (t) 

m -y J 


J 


(2-98) 


The specification of the algorithm is completed by the addition 
of the parameter adjustment mechanism: 



where 


e (t) = y (t) - y M (t) 

Wj(t) = q d [w(t)] 

Yg chosen so that Yg < 2 
' P '^p 


(2-100) 

(2-101) 


and 


(2-102) 
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2. 3. 3. 2 Error Equations 


>1»A 


* J |l M 

Since r(t) la prefilbered by > the goal of the control 

loop is to become a dead beat controller, i,e. , have the closed 
loop transfer function shown in the box in figure 2-15, 

be a pure delay of d steps with a unity gain. From Figure 2-15, 
we obtain 


A* 


d 

*_ _ P 


Ji C x*-qi C w** 2) ) »kJ * * 


(2-103) 


If the plant model is an exact representation of the plant 
there is enough freedom to achieve 



(2-104) 


and the plant output will match the model output. It will be 
shown by an example in Section 5.1. 2. 2 that because this aigoriblwv 
must create a deadbeat ooxtsoi loop to match the reference model, it 
requires a much higher gain in the control loop than other algorithms. 
It is also demonstrated in Section S. 1*2.2 that such high gains 
cause problems in the presence of unmodeled dynamics. The advantage 
of the deadbeat setup is that the stability proof for such a 
system is somewhat simpler than for other algorithms. However, 








the simplicity of the stability proof is no tradeoff for poor 
performance, and the problems of the DA2 algoritJim will be 
demonstrated in Section 5, 2. 2. 2. 

The error equation for DA2 is given below: 


e<t) 




g*B*q' (d 

. 

A 


■£^-1 |[r(t)] 


(2-101S) 


When the plant model is an exact representation of the plant 
the removal of any dynamics except a pure delay in the error 
equation results in a stability proof which is simpler than the 
stability proofs of those algorithms which must account for 
dynamics in the error equations. The error system for the general 
case is represented in Figure 2-16. The equations for DA2 are 
summarized in Table 2-8. 

It should be mentioned here that there is a version of DA2 
in which certain kinds of stochastic disturbances are taken into 
account in the problem formulation [ 48 ] • The modifications are 
very similar to those that are used in the stochastic version of 
DA3 and, since DA3 is a more general algorithm, the effects of 
such modifications will be investigated in the context of DA3. 
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TABLE 2-8 


EQUATIONS FOR DA2 

Plant 

-d 

g q P 

y (t) - £ - a - b - [u(t)l 

Auxiliary 

Variables 

w yi <t) = q i [y<t)l i=0, 1,. . . ,n-l 

w ui <t) = q (i+1) [u(t)l i=0, 1, . . . ,n-2 
9 M 3 m 

„ (t ) = xr(t)] 

r a m 

Input 

u (t) = k T <t)w(t) 

Model 

g q" d 

y M <t) = — ?*[r(t)] 

M a m 

Output Error 

e(t) = y <t) - y (t) 
n 

Parameter 
Adjustment Law 

(" w, (t)e (t) 1 

k(t) = k - ^ 

1-q L J 

Nominal Controlled 
Plant 

-d . * d p 

g*q P B * k r g p q B 

A * (l-q”^K*) A-g q dp K*B 

u p y 

Error System 

-d 

e(t) = [k T (t)„(t)] 


<2-67) 

(2-94) 

<2-95) 

<2-96) 

<2-97) 

(2-68) 

<2-74) 

<2-99) 

<2-103) 

<2-105) 
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2.3.4 Discrete-Time Algorithm No. 3 (DA3) 

2. 3. 4.1 Introduction 

The algorithm DA3 is representative o" the algorithms proved 
asymptotically stable by Egardt [ 12 1 • It:: structure is fairly 
general and it includes many algorithms as special cases [141- 

The algorithm is especially important because one of the 
algorithms included is a version of the Self-Tuning Regulator of 
\strom et.al. [28-31]. The Self-Tuning Regulator is a heuristic 
scheme of combining on-line identification and control to regulate 
a system. Algorithm DA3 extends this concept to what may be 
called a Self-Tuning Controller which has the same structure as 
a Self-Tuning Regulator but can also follow reference inputs. 
Egardt' s work not only enabled the unification of the Self-Tuning 
and the Model Reference viewpoint of adaptive control, but also 
provides the first global asymptotic stability proof of a Self- 
Tuning Algorithm . 

Although the stability proofs of DA3 hold only when there are 
no disturbances present, the algorithm DA3 also represents an 
early attempt of a Model Reference scheme to handle any kind of 
disturbance. The disturbances considered are a very restrictive 


class of stochastic disturbances. 
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2. 3. 4. 2 Plant and Disturbance Models 

The plant and disturbance model for the algorithm DA3 is 
given in eqn. (2-106) . 

-d 

p . 

9 n q B C 

y (t) = (u(t)] +~ [v(t)J (2-1)6) 

where v(t) is a white noise sequence and the degree of C is 

n < n. 
c— 

The second term in eqn. (2-106) represents a restrictive 
class of disturbances consisting only of those stochastic 
disturbances formed by white noise passing through a system 
with the same pole structure as the plant. Thus, if there is 
a frequency with considerable energy present in the disturbance 
due to a pole in the disturbance dynamics, the control loop will 
have a large gain at this frequency due to the corresponding plant 
pole. Thus, the control loop need only adjust to minimize the 
effects of Uhe zeroes of C(s) in the noise dynamics. Indeed, if 
C(s) were equal to a constant, c q , then the algorithm would be 
the same as it would if there were no disturbance at all. 

The class of disturbances represented by the second term of 
eqn. (2-106) does not include such important and common disturbances 
as a constant output disturbance or a deterministic sinusoidal 
disturbance. Such deterministic disturbances may arise directly 
from the environment such as a disturbance at 60H2 caused by power 


\ 
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lines, or a disturbance caused by anoscillatory node in an adjacent 
subsystem. Deterministic disturbances may also be used to capture 
the effects of modeling errors such as output load changes. 

Sin< e the model for DA3 does not include constant or sinusoidal 
disturbances, there is no reason to believe that this algorithm will 
behave any better than any other algorithm in the presence of such 
disturbance. Indeed, in Section 5.2.5. 3, it is shown that such 
disturbances will drive the bandwidth of the nominal controller 
of the DA3 algorithm to the point where the presence of unmodeled 
dynamics will cause instability. 

2. 3. 4. 3 Controller Structure 

With the plant given in eqn. (2-106), the controller structure 
is given in Figure 2-17. The auxiliary variables are generated by 

-<i+D 

w , (t) — Iu(t)J i*0,l, . . . ,m+d-2 (2-107) 

ui (n-i)_(d) 

P L 

(2-108) 
(2-109) 


-x 


w yi (t) = Jn-i)' T ld) Iy(t)1 


x z 0f I# • • • #n^hn -1 
c 


w . (t) « 
n 




Ir (t) ] 


0 X § • • • r n ^ n 


The usual definitions are made as follows: 



£ T (t)w(t> 
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Figure 2-17. Controller structure for DA 3. 















V iMfuiV 


- 121 - 


ORIGINAL PAGE IS 
OF POOR QUALITY 


w(t) 


w (t) 


w (t) 

~y 


k(t) 


k (t) 


ku ( t) 

k (t) 

~y 


(2 


Notice that the dimension of w (t) and k (t) is n , the 

—r — r c 

same as the order of C(s) r the zero polynomial of the disturbance 
dynamics. These variables are added to handle the colored noise 
disturbance. 

The scalar control input to the plant is: 


u ( t) - L (d) [k T (t)w(t>] 

An auxiliary error signal is created by 


e(t) ® e(t) + y (t) 

cL 

e(t) * y(t)-y M (t) 

y a (t) = h(t) (q 1 Ilk(t)] - q d I[k(t)l)^ w^t) 


with 


Wj(t) = q 


-d 


I[w(t)] 


(2 

(2 

<2 

(2 


- 110 ) 


- 111 ) 

- 112 ) 

- 113 ) 

- 114 ) 

-11M 


and h(t) a time-varying gain 
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The Adjustment mechanism is given by 


k(t) * k + 


i-q 


-1 


r w,(t)e(t) 

j . 1 


V*!d (t) Sd (t) 


] 


( 2 - 


h(t) * h + . 

o , -i 
i-q 


(q _1 I [k(t) ]-q -d I Ik(c) ] ) T ^(t)€«t) 
X + w£(t);w^(t) 


( 2 - 


2. 3.4.4 Error Equations 

The system will again be analysed around nominal parameters 
k* with 

k(t) = k* + fc(t) (2-84) 

The nominal control system is shown by the outer box in 
Figure 2-17. It is given by: 


-d „ " d p * (n) (n-1), (d) 

q*q P B* _ g p q K r B P 


,*°P <2 ' 


The error equation is: 


e(t) = 2 


-d -d . 

* P g*m ^ /gBg*q P B* g q P B \ 

;fe— 1 s ; 


[r (t) ] 


-1 -d. 


B 


v C 


h(t)«q -q )I[kl) Wj(t) + ^ ~ [V(t)l 


A A 
V 


116) 


117) 


118) 


(2-119) 


where 


m 
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aV ‘ ,W 

-d" 


U $t 


(a-iao) 


*3..* 


(P-q“*Kj)»-9 ) .<l 1> #k 


The eriroi' system As completed by the addition &f the 
parameter adjustment mechanism given by eqns. (2-AA6) and (2-11?) * 
The error system As represented An Figure 2- AO, The 
equations for DA3 are summarised in Table 3-0, 


3, 3,4.3 i»o», 

With certain choices of filters the algorithm DA3 can be 
made to be equivalent to other well known algoritlune as shown 
by Egardt 1X4 )• 


2. 3, 4. 5. 1 Reduction to DA2 

If the plant to be controlled is modeled as having unity 
relative degree * the aero polynomial of the disturbance dynamics 
is modeled as a constant , the OA3 algorithm may be made identical 
to the DA2 algorithm by removing the additional filtering capability 
provided in Wv3 by the input ’Alter t* and by choosing as auxiliary 
variables lagged versions of the input and output. That is* if 

9«£rtLt n »lf d®i 

Q 


(2-121) 


Figure 2-18. Error system for DA 3. 
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TABLE 2-9 


EQUATIONS F< R DA3 


Plant 


Auxiliary 

Variables 


Input 

Output: Error 


-d 

P 

V B 

y (t) =» 


- [U't)J + ~ Iv(t)J 


- (i + l) 

w ui (t) - [i (t) ] ; i*0 f l,...,n+d-2 


-x 


w yi (t) «* -|L— [y <t) J ; i«0,l, ... ,n+n c -l 


q M 

w . (t) « — - - — [r(t)J» i=0,l r . . . ,n < n 

rx 




w(t) = 


w (t) 


‘k (t) 

-r 


—r 

w (t) 

? k(t) 

k (t) 

-u 

— u 

w (t) 


k (t) 

T 


,-y J 


u(t) = L[k (t)w(t) 1 


e(t) = y(t) - y (t) 
M 


Auxiliary Error 6(t) = e(t) + y a (t) 


y & (t) * -h(t) ( (q ^-q d )I[k)) Wj(t) 
Wj(t) « q d I [w (t) ] 


(2-106) 

(2-107) 

(2-108) 

(2-109) 

( 2 - 110 ) 

( 2 - 111 ) 

( 2 - 112 ) 

(2-113) 

(2-114) 


(2-115) 


Parameter 
Adjustment Lav; 


Nominal Control- 
led Plant 


Error 

Equation 
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k(t) - k + 


1-q 




r Wj(t)e(t) 


h(t) 


h + -=— , 
o.-l 
1-q 


(2-116) 


( (q" 1 *q“ d ) i (k (t) ] ) (t) e (t) 


V*d (t) Sd (t) 


■j (2-117) 


-d 

■*“ P n* 


-d 

g_q p k* plb 

-g. . ■■ k 


(P-q -1 K*)A-g q K*B 

^ U p y 




(2-118) 




B 

- h(t)((q“ 1 -q" d )I[K(t)]) ,r WjU) + ^ IV (t)J ( 2-i20) 


B 


_ _ 1„* 

p-q k u 


(P-q” 1 k*)A-g q~ d P K*B 
^ u p y 


(2-121) 
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DA2 and DA3 are identical. If more general disturbances dynamics are 
allowed through more general C(s) , DA3 is identical to a stochastic 
version of DA2 given in [48] . The two algorithms differ in the adjustment 
mechanisms when the relative degree of the plant is greater than unity. 

It will be shown in Section 5.1.3, that the added input filter 
L, which is present in DA3, allows the designer an important degree of 
freedom not available in DA2. With the proper choice of L, the DA3 
system can match the reference model with much lower loop gains than the 
DA2 system. It is shown in Section 5.1.3 that the added flexibility 
created by the filtering of L allows the designer to create a system 
which is better able to match the reference model and maintain stability 
in the presence of unmodeled dynamics. 

2 . 3 . 4 . 5 . 2 A Self-Tuning Controller 

The algorithm of DA3 can also be made equivalent to what is referred 
to as a Self-Tuning Controller. A Self-Tuning Controller which can follow 
reference inputs can be created from a standard Self-Tuning Regulator by 
feeding the reference input through the reference model to the output as 
suggested by Astrom, et al. , [28] . If the filtering of L is removed and 
shifted versions of the input and output are used as auxiliary variables, 
i.e., if 

L=P=1 (2-122) 

in DA3, the DA3 algorithm reduces to a minimum variance Self-Tuning 
Controller with extended identification [28,30]. 
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2. 3.4.6 Analysis 

If the model of eqn. (2-106) represents the plant and disturb- 
ances exactly, the nominal control system of eqn. (2-118) can be 
turned into a pure delay, i.e. 



(2-123) 


A choice of parameters which make eqn. (2-123) true will 
produce perfect model matching if there is no disturbance. 

The effect of a disturbance will be minimized if the para- 
meters, k (t) , can be adjusted so the nominal feedforward operator 
— r 

of the reference input 


K*(q“ X ) 


k 

~ro 


k".q 
rl 


-1 


-n 


+. . . + k 


rn 


(2-124) 


c 

-1 

as seen in Figure 2-17 can be made to match C(q ) of eqn. 

(2-106) . This will cause the identical denominator of eqn. (2-118) 
and eqn. (2-120) to include c(s) as a factor. The inclusion of C(s) 
as a factor in A^ eliminates the effect of C(s) in the disturbance 
dynamics and minimizes the effect of the last term representing the 
disturbance in eqn. (2-119) on the error. It has been shown by Astrom 
and wittonmurk [ 28 ] that, if this version of algorithm DA3 with the 

filters L(q "S and P(q *)' chosen as in eqn. (1-122) converges at all, 


it will converge to a system which minimises the variance of the 
auxiliary error, e, of eqn. (2-119). 
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2.3.5 Normalizing Factors in the Adaptation Mechanism 

In eqn. (2-99) of DA2 and eqns. (2-116) and (2-117) of DA3 
there is a normalizing factor, + w^ttOw^tt), in the parameter 
adjustment mechanism. As will be seen in Section 5.1.2 
and Section 5.1. 3, this normalizing factor is important if 
the algorithm is to maintain stability in response to constant 
reference inputs in the presence of unmodeled dynamics. The 
normalizing factor allows an upper boind on the gain of the 
error system loop to be set independent of the size of the 
reference input, if the reference input is constant. An upper 
bound on the gain of the error system limits the bandwidth of the 
error system and avoids the excitation of unmodeled dynamics and 
the resulting unstable behavior. 

There are versions of DA2 given in 1 10 1 and DA3 given in 
tl2 ] in which a stochastic approximation or a least squares 
identification technique 3s used for parameter adaptation. These 
techniques accumulate the normalizing factor over time so that the 
gains in the adaptation mechanism are time-decreasing and go to 
zero asymptotically. 

Clearly, an algorithm whose adaptive gains go to zero can no 
longer satisfactorily adapt to changing parameters in the plant, 
if the changes in the parameters occur after the adaptation gains 
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have gotten very small. This problem is dealt with in practice 
by discounting old values of the normalizing factor so that 
if the signals in the system are constant, the adaptation gain 
will be a steady state value. An example of the use of such a 
"forgetting factor" follows: 

Suppose eqn. (2-99) Of DA2, repeated below 

(2-99) 

(2-124) 
(2-125) 

The parameter A is the forgetting factor. Setting A=0 reduces 
eqns. (2-124) and (2-125) back to eqn. (2-99). Setting A 
equal to one would produce a time decreasing adaptation gain. 

Algorithms with time decreasing gains will not be considered 
in the sequel since we are interested in asymptotic properties 
of adaptive algorithm and such algorithm are asymptotically 
not adaptive at all. 


k(t) « k - 


w (t)e(t) 

X d 


V^d (tl Sd (t) 


were 


k(t) = k 


w.(t)e(t) 

_ _X_ 


-o i_ q -l l+g(t) 


With 


g(t) = Ag(t-l) + w d (t)w d (t)j g(o)=0 
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Algorithns with forgetting factors, 0<A<1, will not be 

considered separately as these algorithms will react very much 

like those algorithms with A=0 for the situations considered 

in the sequel. Indeed, if w. (t) is constant as it is taken to be 

"d 

throughout Section 5.1, we have 

g(t) = S^tjw^t} (2-120) 

and the effects of g can be subsumed in the parameters Y 

and A of eqn. (2-99) . 
o 

In addition, the detailed behavior of g(t) is not important 
to the heuristic arguments made in Section 5.2. Therefore, only 
the algorithms as presented throughout Section 2.3 will be 


considered in the sequel 
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CHAPTER 3 

CONTINUOUS TltyE ADAPTIVE SYSTEMS WITH UNMODELED 
DYNAMICS AMP CONSTANT INPUTS 

3.1 Introduction 

In this chapter the behavior of the continuous-time adaptive 
control algorithms which were introduced in Section 2.2 in examined 
for the case where the plant contains unmodeled dynamics, the 
reference input is constant, and t^ere are no external disturbances. 

Until the present research, little was reported in the 
literature dealing with the important problem of how adaptive 
control algorithms would behave, if they were implemented on a plant 
whose actual order is larger than the order assumed for the plant 
in the adaptive design process, i.e., if they were implemented on 
a plant with unmodeled dynamics. 

Anderson and Johnson |52,53j and Anderson and Johstone [ 54 J 
have obtained some results indirectly by showing that, with a 
"sufficient excitation" condition, the discrete-time algorithm DA2 
is exponentially stable ,implying that the system should be able to 
retain stability in the presence of some unmodeled dynamics or 
disturbances. There is, however, no estimate of the precise 
nature of unmodeled dynamics that are acceptable for the retention of 
stability. In fact, it is shown in Section 5. 1.2. 2 and Section 5.2.4 that 
the algorithm DA2 will have serious stability problems in the presence 
of a large class of unmodeled dynamics. 
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A direct examination of the effects of unmodeled dynamics in 
the adaptive observer problem has been published by loannou and 
K >kotovic [51,53]. Their research using singular perturbation 

theory displayed that high frequency unmodeled dynamics can cause 

significant errors even in the open-loop adaptive observer problem. 

* 

loannou [52 ] in his Ph.D. thesis has extended the singular 
perturbation analysis for adaptive control algorithm CAl. For 
some of the situations where the plant contains very high frequency 
unmodeled dynamics, loannou has shown that, if the system is 
started within a certain region of initial conditions, then the output 
error will approach zero asymptotically in the absence of reference 

1 

inputs. Thus, loannou has deduced the fact that the linearized error 
system is asymtotically stable, a fact that agrees with 
the analysis of this chapter; he also has derived an estimate of 
region of attraction of the linearized error system. However, 
loannou can obtain results for the standard CAl algorithm for a much 
smaller class of unmodeled dynamics than the analysis of this chapter. 
In addition, his results do not predict when instability can occur as 
the results of this chapter do. His results were obtained only for 
the case of zero reference input. 

loannou has also analyzed a modified version of CA1J his modifica- 
tion will be discussed in Chapter 4. Finally, loannou did not examine 
the behavior of the CAl algorithm in the presence of disturbances as 
we have in Chapter 4. 

* 

loannou' s thesis became available to the author during the 
preparation of the final draft of his dissertation. 
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Preliminary results of the research presented in this 
dissertation have also appeared in the literature. In Rohrs, 
et.al., [1], simulation studies which displayed the dangerous 
effects of uiimodeled dynamics on one adaptive control algorithm 
were reported. In Rohrs, et.al. [ 2 ], the effects seen in [ 1 ] 
were displayed analytically for first order systems and a number 
of algorithms. The present chapter of this dissertation is an 
expansion of the work reported in [2] . 

Thus, the contents of this chapter represent the first an- 
alytical results of the effects of unmodeled dynamics upon a wide 

class of adaptive control systems, using an analytical technique 

which is shown to be useful both in analyzing the effects of 

unmodeled dynamics upon a system with a constant reference input 

and no disturbances and, also, in providing a guide for adjusting 

the structure of the gains for adaptive systems to minimize the 

effects of unmodeled dynamics. 

From this analysis, backed by simulation results, the 
following cone lusiors are made: 

• The algorithm CA1 cannot be made to be stable 
for all reference inputs unless the forward operator 
in the error system of Figure 2-3 can be made to 
be positive real. This means that CAl will not be 
even locally stable for all constant inputs in the 
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presence of a large class of unmodeled dynamics 
including all unmodeled dynamics with a pole 
excess of two or greater. 

• With some prior information about the nature of 
the unmodeled dynamics , the parameters of the 
algorithms CA2, CA3, and CA4 may be picked, using 
the analysis technique of this chapter as a guide, 
so that these algorithms retain local stability for 

* 

all constant reference inputs and no disturbances. 

By local stability, we mean that the system will 
remain stable, if the numerical values of the para- 
meters that describe the adaptive algorithms are 
close, at the initial time, to some nominal set of 
parameters , 

The contents of the remainder of the chapter are as 
follows: 

Section 3.2 contains a description of the analysis technique 
used throughout the chapter. Sections 3.3 to 3.6 contain, respec- 
tively, the analysis of algorithms CA1 to CA4 for constant reference 
inputs with and without unmodeled dynamics. Section 3.7 contains 
the conclusions of the chapter. 


The stability behavior of these algorithms in the presence of 
unmodeled dynamics with more general inputs and disturbances 
is not encouraging as shown in Chapter 4. 
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3.2 Explanation of the Analysis Technique Used for Adaptive 
Systems with Unmodeled Dynamics and Constant Inputs 

The adaptive control systems presented in Section 2.2 are non- 
linear, time- varying systems. In order to perform some analysis, 
in addition to the original Lyapunov-based stability analysis and 
to be able to analyze even local stability properties in the presence 
of unmodeled dynamics , a linearization technique is used. The 
immediate consequence is a linear, time-varying system. By assuming 
further that the reference input and, therefore, the model output, 
are constant, the system is transformed into a linear time-invariant 
(LTI) system. At this point, then, the well known analysis tech- 
niques for LTI systems, such as root-locus, Nyquist, Routh-Hurwitz, 
etc. , can be brought to bear on the adaptive systems. 

The assumptions used in the linearization technique correspond 
ta the following situations? 

(1) It may be assumed that, at the start of the analysis, 
the state and parameters of the adaptive controller 
are close to some desired values. Such a situation 
could develop when the asymptotically stable adaptive 
controller has already been operating for a long 
period of time with sufficiently rich inputs and is 
therefore close to final convergence. 
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4 i * 

YTUm* * * 

{2) It could also arise when the plant parameters are 
fairly well known a priori and the adaptation is 
employed as a fine-tuning mechanism. 

Clearly, any poor behavior under these relatively benign 
circumstances must be cause for alarm concerning the overall 
cehavior of these algorithms . 

As with any analysis based upon linearization, there is a 
finite subset of parameters and signals for which the linearization 
will give accurate predictions of the system behavior. There is, 
as yet, no estimate of how large that subset is for the linear- 
izations carried out in this dissertation. At various points 
throughout this dissertation, the reader will encounter situations 
where either the parameters or the signals of the system move away 
from the subset of parameters and signals for which the particular 
linearization considered would give an accurate prediction of the 
system behavior. 

That the linearization analysis is valid only locally, is a fact 
of life that one must accept. This shortcoming can be dealt with, as 
is done in Section 3.3.S, by performing a set of linearizations around 
different operating values to gain more global, albeit limited, insight. 
Many of the properties which have been discovered about adaptive control 
systems operated in the presence of unmodeled dynamics can even be 
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displayed with plants that are nominally first order. More 
specifically, systems will be studied and digital simulations 
will be presented whete the plant is a first order system with 
some additional high frequency unmodeled dynamics and the adaptive 
controller is designed assuming that the plant is first order. 

All of the analysis in this chapter assumes that the 
unmodeled dynamics of the plant are known exactly by the analyst. 

If only certain characteristics of the unmodeled dynamics are 
known (as is always the case) , the analyst must use engineering 
judgement to analyze the adaptive system with sets of specific 
unmodeled dynamics which will capture the behavior of the entire 
class of unmodeled dynamics which may occur. 

The simulation® presented in this and the next chapter are 
accomplished by converting the continuous system into an equivalent 
discrete-time system using a sampling interval of T“.Q01. This 
sampling frequency is nearly one hundred times faster than the 
fastest signal present, leaving little doubt as to the closeness of 
the approximation of the simulation results to the actual continuous 
system? in other words, the instability of the closed- loop adaptive 

V t 11 . 

control confirmed by computer simulations is not due to poor 
numerical approximation of a continuous-time system by a discrete- 


time system. 
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3.3 Analysis of CA 1 
1.3.1 Introduction 

In this section, we present the analysis of algorithm CAl 
presented in Section 2.2.1. It is shown that the linearised 
analysis introduced in Section 3.2 is a useful tool for the 
study of this algorithm. 

Based upon the linearized analysis and supported with 
computer simulations, our conclusions regarding the CAl 
algorithm • are as follows : 

• Even in the absence of unmodeied dynamics the 
algorithm can generate high frequency control 
inputs to the plant for sufficiently large cons- 
tant reference inputs. 

* In the presence of unmodeled dynamics, the adap- 
tive system will become unstable for sufficiently 
large constant reference inputs. 

The analysis begins in Section 3.3.2 where a first order system 
with no unmodeied dynamics is studied, followed in Section 3.3.3 
with a numerical example of such a system. In Section 3.3.4, 
the behavior of the CAl algorithm is analyzed when an adaptive 
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controller designed for a first order system is implemented on 
a plant that, in addition to the nominal first order dynamics, 
has an unmodeled high frequency pole pair. A numerical example 
of the type of system analyzed in Section 3.3.4 is provided in 
Section 3.3.5 and much insight about the behavior of the CAl 
algorithm is gained in examining this example. Section 3.3.6 
provides a discussion of the analysis technique for higher order 
systems. Section 3.3.7 demonstrates the flexibility of the 
technique by analyzing a numerical example where the unmodeled 
dynamics are non-minimum phase. Finally, Section 3.3.8 states 
our conclusions concerning algorithm CAl. 

3.3.2 A First Order System with No Unmodeled Dynamics 

Assume initially that the plant is actually first order with 
no zeroes, i.e. 

y <t) «* — [u(t) ] ; g > 0 (3-1) 

p s+a p 

Assume also that the adaptive controller is designed using CAl 
and assuming properly that n=*l and m*0. The equations from 
Table 2-1 become: 



r(t) 


k (t) 

w(t) =* 

y(t) 

k(t) ■ 

k (t) 

y J 


w(t) 


(3-2) 
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y M (t) “ Ir(t)] <3-3> 

M 


u (t ) = 

k (t)r(t) + k (t)y(t) 
*■ y 

(3-4) 

e (t) = 

yttH^tt) 

(3-5) 

k r (t) = 

• 

Jc r (t) = -yr (t)e(t) 

(3-6) 

k (t) = 

y 

K y (t) * -yy(t)e(t) 

(3-7) 


where F has been chosen as 


Let 


and 


Then 


and 



cTB _ M M 

" *k 
g b 

e(t) = IK (t)r(t)+k (t)y(t)] 

r y 


(3-8) 

(3-9) 


(3-10) 


(3-11) 


(3-12) 
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Using eqn. (3-3), eqn. (3-12) can be written in differential form as: 
e(t) - -« M e(t) + 9pt^ r (t)r (t)+k (t)y (t) 1 . (3-13) 

The entire error system now can be derived from eqns. (3-6), 
(3-7) And (3-13) as follows: 


d__ 

dt 


e(t) 
k (t) 

y 

, ic (t) 

L r . 


" a M 9 p y(t) 


-Yy(t) 

-yr(t) 


0 

0 



(3-14) 


Note that this system (3-14) is non-linear due to the fact 

that 

y(t) - y M (t) + e (t) (3-15) 

2 

so that there are e terms on the right-hand side of eqn. (3-14). 

This type of system has been shown to be stable by Lyapunov analysis 

g o 

as explained in Section 2. 2.1.5. Note that is strictly positive 

s+a M 

real. Further analysis has shown that lim e(t)=0. [ 3 ). 

t-*» 

Furthermore, if the signal r(t) is "sufficiently rich" the 
whole error system is globally asymptotically stable with a zero 
equilibrium point [ 20]. 
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In order to achieve some insight into the dynamic behavior 

of the error system (3-14), a local , as opposed to global view, 

will be taken. Assume that the output and parameter errors 

are small and linearize the system around zero error. The only 

change that occurs in eqn. (3-14) is that y is replaced by 

y**y„. The linearized system is 
N 



e(t) 


r* * 

-a u g y* g r 


e(t) 

d 

dt 

k <t) 

y 

* 

M p p 

-yy* o o 


k (t) 

y 


k (t) 


-yr 0 o 


k (t) 


r 


. J 


L r J 


If, in addition, it is assumed that r and hence y* are cons- 
tant, eqn. (3-15) represents a linear time-invariant system. 

The characteristic equation for the system (3-15) is: 

s( s 2 +a s+g yd*)-0 * (3-16) 

m p 

where 

.**22 

d « y + r (3-17) 

One pole of the error system (3-15) remains fixed at the 

origin while the other two can be thought of as being determined by 

2 

a root locus pattern associated only with the (s +a s+g yd*) part 

H p 

of eqn. (3-16) using d* as the gain parameter) this is illustrated 
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in Figure 3-1. The diagram of Figure 3-1 will be referred to 
as the d*^root-locus of eqn. (3-16) , 

From Figure 3-1 and eqn. (3-17) it is seen that for large 
constant reference inputs, r, the algorithm produces high 
frequency oscillations in some subspace of (ejk^k^) end 

through eqn. (3-4) , namely 

u (t) = k (t)r(t) + k (t)y(t) (3-4) 

r y 

in the plant input u(t) as well*. Thus, high frequency controls 

will be present for large reference input values even when this 
input is constant, the plant is first order, and the adaptation 
process is in the final approach to convergence. 

origin is associated with the 


sufficiently rich to produce 
approaching zero, the 
subspace defined by 


The pole that is fixed at the 
eigenvector 

r 

o 

r 

-y' 

Thus, a constant input is not 
parameter convergence. Instead of 
parameter errors approach a linear 


e=Oj k - 

y 


r 

— i 

y 


(3-13) 
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On this subspace, the output error remains zero so that 
there is no further adaptation taking place. 


3.3.3 A Numerical Example of a First Order System with 
No Unmodeled Dynamics 

An example/ which will be carried throughout this and the next 
chapter, is presented to verify the oscillatory characteristics 
of the CA1 algorithm. 

Assume that the plant is accurately described by the first 
order system 


y (t) = Iu(t)1 <3-19) 

Suppose that the desired model behavior is given by: 


Figure 3-2 shows the plant and model outputs for a digital 
computer simulation of the non-linear adaptive system CAl. The 
simulation was started with k =k “y^y =0, an adaptive gain v=1.0 

U y fj 

and a constant reference input of r s 2.5. The plant output/ y(t), 
tracks the model output well after 4 seconds. Note in Figure 3-2 
that there is an oscillation in the output error at a frequency 
approximately equal to the frequency of U>=4. 75 rad/sec which is 
predicted by the d*-root locus of Figure 3-5. Figure 3-4 shows 






Figure 3-2. Outputs from simulation of CA1 with r=2.5. 
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PARAMETERS 
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* 

6 « * ** ***C 

the parameters for this simulation.- 'The desired parameters which 
would make the controlled plant match the reference model 
exactly for this example are: 



The parameters as seen in Figure 2-4 oscillate at the 
frequency of 03=4. 75 rad/sec. as predicted by the previous 
analysis and then converge not to their desired values but to 

k - 0.94 k « -0.44 
r y 

Subtracting the desired parameters from the final values of the 
parameters yields the final values of the parameter errors 

-k = 0.56 = k 
r y 

Since, for this example, y*=r, the parameter errors have 
indeed converged to the subspace given by eqn. (3-18) . 

Finally, Figure 3-5 shows the outputs for the simulation 
carried out with a larger reference input r=5.0. The oscillation 
is now twice as fast as before. This is once more predicted by 
the. d*-root locus. Note from eqn. (3-16) that the frequency of 
oscillation of the error system would also double if the adaptation 

gain, y, or the unknown plant gain, g , were quadrupled. 

P 
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Figure 3-5. Outputs from simulation of CA1 with r=5.0. 
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Figure 3-6 shows the time variation of the parameters when 
r**5.0. Notice that they now converge 'to 1 

t . * 

k « 1.21 k « -0.71 , 
r y 

a set of values different from those to which they converged 
when the simulation was run with r*«2.5 but still on the predicted 
subspace of eqn. (3-18) . 

Thus we have seen in Section 3.3.2 and Section 3.3.3 that even 
when the CAl algorithm is implemented on a first order system with 
no unmodeled dynamics and no disturbances) and is presented with 
only constant inputs, high frequency parameter oscillations which 
give rise to high frequency control activity will result for 
sufficiently large constant reference inputs. 

It will be seen in the next two sections that such high 
frequency control activity will lead to instability in the 
presence of even high frequency unmodeied dynamics. 

3.3.4 A First Order Nominal System with Unmodeled Dynamics 

Now the effects of unmodeled dynamics will be considered. In 
the sequel it will be assumed that an adaptive controller is 
designed assuming that the plant and reference model are both first 
order. The behavior of the system will then be analysed around a 
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desired set of parameters for the case where the plant' s order 
and relative degree are different from what was assumed when the 
controller was designed. Thu immediate discussion will consider 
the case where the plant consists of a nominal first order system 
plus a high frequency pole pair which is unmodeled in the sense 
that its presence is not taken into account in the adaptive 
controller design. These results will be expanded in Section 3.3.6 
to include more general unmodeled dynamics. 

Assume that the reference model as given by eqn. (3-3) as 
in Section 3.3.2 but that now the actual plant is represented 
by: 


y(t) 


(i. 

a ul a -u2 \ 

1 s+a 

(s+a. . ) (s+a. ._) / 


i(t)] 


(3-21) 


where a^, a^# are either real numbers or complex conjugates 


with l a ul ! > | a M | and 


l a u2l > iV‘ 


The adaptive system is 


designed using CA1 with the assumption that the plant is first 
order with no zero so it is described by eqns. (3-2) to (3-8). 

The error equation can be deduced from Table 2-1 and is as follows: 


■<« - (*£ - *£) t*<«] + 


where, in view of eqn. (2-22) 

2!®!.= 

« * 


k*g a ,a „ 
r p ul u2 


(S+a> (s +a ui ) (S+a u 2 ) - g p a ui a u 2 k ; 


(2-24) 


(3-22) 
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n ua* ir 

The analysis that follows is valid for any choice of k* and 

y 

k*. The motivating choice, however, one that is consistent with 
the idea of k* and k* being the desired values, is to pick k* and 


* q*B* 

k so that ~Tr~ matches 

tr 7V " 


g. b 


M M 


over as large a low-frequency 


r ■“ A 

range as possible. This approach will be demonstrated later in 
an example. 

Assume that k* and k* have been chosen and represent 

g B 

■ as: 


g*B* _ 
A* ’ " 


s -tans +a*s+a! 


(3-23) 


Let 


•a‘« 


■{& - ¥-)h 


(3-24) 


be the driving term of the error equation. Note that if r(t) 
consists mostly of low frequencies and is chosen to match 

A 

the model over low frequencies, the signal e, (t) will correspond 

d 

to a small perturbation term. The error system can now be derived 
from eqns. (2-24), (2-12), and (3-23) and is as follows: 
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e(t) 


0 

1 

0 

0 

0 


e(t) 


1 

d 

e(t) 


0 

0 

1 

0 

0 


e(t) 


0 

dt 

e(t) 


* 

- a o 

- a I 

"®2 

£-y<t> 

*r 

j£r(t> 

r 


e(t) 


0 


•VW 

k y (t) 


-yy (t) 

0 

0 

0 

0 


k y (t) 


0 


k r (t) 


-Yr (t) 

0 

0 

0 

0 


Jc r (t) 


0 


— 


— 






-■* ■ :mm 


» — 


( 3 - 25 ) 


Equation (3-25) can be linearized around the zero error 
condition as was done in eqn. (3-14) , which again simply replaces y 
with y =y M * Assuming tl at r and, consequently, y* are constant, 
renders the system linear and time-invariant. The resulting charac- 
teristic equation is: 



* A 2 *2 

with d = r +y (3.17) as before. 

Again, there is a pole of the system (3-25) fixed at the origin 
associated with a subspace in the parameter space where no further 
adaptation occurs. Now, however, the d*-root locus of eqn. (3-26) 
contains a third-order pattern so that, for d* large enough, the 
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error system will not only be oscillatory but will also become unstable . 
This is true even when r and y* are constant and the system starts 
near the desired parameter set. 


3.3.5 Numerical Example of a First Order Nominal System 
with Unmodeled Dynamics 

For this example, we add an unmodeled pole pair at s«-15+2j 
to the plant considered earlier in Section 3.3.3. The plant is 
then described by: 

M 

Let the model be as before: 

V« =(ih) 

3.3.5.3 Linearizing about a Desired System 

One reasonable way to pick the point in parameter space about 

* q*B* 

which to analyze the system is to choose so that has 

one pole which matches the model pole at s=-3jand to let the high 
frequency poles go as they may (assuming, as is the case, that they 
will remain well within the stable region and at a higher frequency 


than the poles of the model) . 
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Substituting the values of eqn. (3-27) into eqn. (3-22) 
yield the equation of the nominal system for this example 


k* 458 


q*g* 

" ■ ■ ' - M " III ■■■! ■ ■ 

A s 3 +31s 2 +259s4229-450k* 


(3-28) 


The root locus on k^ for the poles of eqn. (3-28) is shown 
in Figure 3-7, At a value of k* * -Q.65j the dominant pole of the 
nominally controlled plant will match the model pole. Substituting 
the value k* * -0.65 into eqn. (3-28), the poles of the nominally 
controlled plant are found to be located at 

s«-3{ s*-9.4? s®-18.6 

Two poles have remained at relatively high frequencies so with 
the proper choice of k* , the nominally controlled plant,matches the 
model closely over a broad range of low frequencies. A value of 
k* » 1.14 will produce the desired unity d.c. gain, and the nominal 
controlled plant then becomes; 


ft * 
9 B 

“XT 


525 


s 3 +31s 2 +259s*525 


(3-29) 


Using this as the desired systemi the characteristic equation 
of the error system becomes, according to eqn. (3-26) 

(3-30) 

A value of "Y*»l will be used in the sequel. The d*-root locus of 
eqn. (3-30) is given in Figure 3-8. 


s(s 4 +31s 3 259s 2 +525s+458Yd*)»0 
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Figure 3-7. k*-root locus of eqn.(3-28). 
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Figure 3-8. d*-root locus of eqn. (3-30) . 
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The linearization about this particular choice of k* , k* 

y r 

predicts instability when d*>8.95 which will occur when the 
reference input, r, is such that r>2.11. Figure 3-9 shows the out- 
puts and the parameters of a simulation run with r=2.5. The initial 

conditions of the simulation were k =-0.6, k =1.0, Y=1.0, and the 

y r ' 

plant and model states had zero initial conditions. The linear- 
ization with the desired system given by eqn. (3-29) predicts error 
system poles at 0.34 +j4.7 and -15.8+j2.7. The simulation results 
of Figure 3-9 indicate a stable system with an oscillation at the 
frequency of around U)=H rad/sec. The results also indicate that 
the parameters have converged to the values k* = -1.57 and 

y 

k* = 2.08. Thus the linearization around the initial set of para- 
meters, k* = -0.65 and k* = 1.14, does not give an accurate prediction 
of the system behavior when the parameters have moved to the values 

k* = -1.57 and k* = 2.08. 

Y r 

Note that with the system converging to k* = -1.57 and k* = 2.08 
the poles of the nominal control system as defined by eqn. (3-28) 
have moved to 

s=-20. 7; s=-5. 15± j4,4; s=-5.15-j4.4 

so that the nominal control loop no longer matches the reference model 


but is of a higher bandwidth. 



PARAMETERS OUTPUT 
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Thus the analysis of this subsection show that although the 
control may remain stable for constant reference inputs that are 
larger than r=2.11, it cannot be expected to match the reference 
model for inputs of this size. If a reference input larger than 
r=2.11 is used, the; linearization around the set of parameters which 
will produce good model matching is unstable , so the system must 
necessarily move away from this set of parameters. 


3. 3. 5. 2 Linearizing about the New Parameters 

By linearizing the plant around the parameter* 

k* = -1.57; k* = 2.08 (3-31) 

y r 

to which the simulation of Section 3. 3. 5.1 eventually converged 
the asymptotic behavior of this simulation can be explained. 

With the parameters of eqn. (3-31) , the nominal controlled plant 
of eqn. (3-28) is 


g*B* _ 


950 


A s 3 +31s 2 +259s+950 


(3-32) 


Substituting the proper values for the nominal controlled plant 
and d *=12. 5, corresponding to r=2.5, into eqn. (3-26) yields the 
characteristic equation for the error system linearized around the 
parameters of eqn. (3-31) with r=2. 5 

s (s 4 +31s 3 +259s 2 +950s+5725)=0 
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This equ?;.i.on has a dominant pole pair at s*-0. 3+^5. 2 which 
corresponds well to the results of the simulation. 

3. 3.5. 3 Using Linearization to Predict Instability 

As was mentioned in Section 3.2, a linearization technique is, 
in its essence, a local technique. If a linearization about a specific 
set of parameters is unstable, then it shows only that the adaptive system 
will not converge to that set of parameters. If a reference input 
can be found so that the linearization around any set of parameters 
is unstable, then it follows that the adaptive system will not 
converge to any constant set of parameters. It is possible that the 
algorithm may maintain stability by moving among parameters sets. 

However, it is the experience of the author, attained through 
simulations, that this phenomenon does not occur. Thus, the derivation 
of the numerical value of a constant reference input ,for which no set 
of parameters which produce a stable linearization, can be found, will 
be taken as a prediction of instability. Such a prediction must be 
verified by simulation. 

For the example of this section (Section 3.3.5), a reference 
input (equivalently, a value of d*),for which there is no set of 
parameters which produce a stable linearization, can be found analytically 
by applying the Routh-Hurwitz test for stability to the following equation 

s 4 +31s 3 +259s 2 +(229-458k*)s + 458d**0 

Y 


(3-33) 
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This equation (3-33) is derived from eqn. (3-26) for this example. 
Its roots are the poles of the error system linearized around 



The Routh-Hurwitz test leads to three stability conditions, 
all of which must be satisfied. 

229-458k* > 0 

y 

(259) (31) - (22S-458k*)> 0 (3-34) 

. 2 

- (229-458k*) 

- X — + 259 ( 229-458k* ) > (31) 458d* (3-35) 

31 y " 

From eqns. (3-33) and (3-34) , one finds 

-17.03 < k* < 0.5 (3-36) 

y 

The left hand side of ineq. (3-35) is maximized for 
k* = -8.26 which in turn implies 

d*< 36.62 (3-37) 

Equations (3-36) and (3-37) must be satisfied simultaneously 
in order for the error system to have a stable linearization. 

When k* > 0.5 the nominal system is unstable and the d*~root 

y 

locus of the error system cannot return the poles to the left-hand 


plane 
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Figure 3-10b shows that when k* is negative and small in magnitude , 
the d*-root locus moves the poles arising from the modeled portion of 
the plant and the adaptation mechanism into the right-half plane. When 
k* gets too large and negative, either the d*-root locus moves the 
"unmodeled" poles over the ju)-axis as shown in Figure 3-10c, or, k* is 
large enough to have already created unstable poles out of the "unmodeled" 
poles. 


The marginally stable condition of d*«36.62 corresponds to a 
constant reference input r=4.28. The marginally stable oscillation 
will occur at U)=11.4 rad/sec. 

The nominal system for this most stable configuration is 
obtained from eqn. {3-28) 


g*B* _ 3996 

A* (s+27) (s+2+jl2) (s+2- jl2) 


(3-38) 


Thus, the nominal system has moved to a high bandwidth system in 
order to maintain stability in the error system. 

Figure 3-11 shows the output and parameters of a simulation 
with the same initial conditions as the simulation of Section 3. 3. 5.1 
but with r=*4.1, which should lead to a stable system. Note the 
characteristic frequency of about 11 rad/sec in the plant output and 
the convergence of the parameters to ky=-8 and k r «8. This is as 
predicted as k* is within the small range of values satisfying 
eqn. (3-35) for the value of d* used. 



-w 


-20 


20 ' 


\ 
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Figure 3- 10c. 1^ large and negative. 

* * 

Figure 3-10. d -root loci of eqn.(3-33) for different conditions. 
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Figure 3-12 shows the output. pf a .simulation with a constant reference 

'% 'V 

input r*4 .3 for which the Routh-Hurwitz tost predicts that there is no 
nominal system for which the error system is stable. The oscillations in 
the output decrease in the earlier stage, as the parameters move to a more 
stable configuration but, since all configurations are unstable, the error 
system eventually becomes unstable. Only the onset of instability is 
shown in Figure 3-13 but a continuation of the simulation shows that all 
signals "blow up" quite rapidly. 

3. 3. 5. 4 Summary of Results 

Through the use of an example, for CAl, we have demonstrated that 
the linearization technique of Section 3.3.4 is a powerful tool in the 
study of adaptive control algorithms with constant inputs and no dis- 
turbances. The following use of the linearization technique has been 
demonstrated in this example: 

• The linearization technique can be used to establish 
if an adaptive system can possibly converge to a 
particular set of parameters as was done in 
Section 3. 3. 5.1. 

• The linearization technique can be used to predict 
the asymptotic behavior of the plant output and 
parameters as the parameters approach constant 
limits as was done in Section 3. 3. 5. 2. 



PARAMETERS 
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• The linearization technique can be used to predict 
possible system instabilities for certain constant 
reference inputs as was done in Section 3. 3. 5. 3. 

Instability is predicted by finding reference inputs such that 
there is no set of parameters which produce a stable linearization. 
Such a reference input may or may not exist depending upon the actual 
dynamics of the plant, the design of the controller and the reference 
model. If such a reference input does exist, it may be found by the 
following method: 

1. Find the characteristic polynomial of the error system in 
terms of the adaptive system parameters and the reference 

input as was done in eqn. (3-33) in Section 3. 3. 5. 3 

* 2 

(where the equations is in term of d =2r ) . 

2. Find conditions on the parameters and reference input 
that are necessary so that the characteristic equation 
of the error system has only left-half plane zeroes, 
using the Routh-Hurwitz test. 

3. Find the values of reference input for which the 
conditions found in Step 2 cannot be satisfied. 

This method may require a great deal of computational effort for 
higher order systems, but will always produce all the values of 
reference input for which no set of parameters which produce stable 
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linoarizations exist. Other mothods,such as that used in Section 5. 1.2. .1.1, 
may be used to demonstrate that a particular value of reference input 
will not be able to produce a stable linearization. 

In addition to the demonstration of the use of the linearization 
technique, the example of this section demonstrated certain problems 
with the algorithm CAl. These are summarized as follows: 

• In the presence of high frequency unmodeled dynamics, 
the algorithm CAl may become unstable when a cons- 
tant reference input, which is too large, is used. 

• In the presence of high frequency unmodeled dynamics, 
there may be a class of reference inputs which are 
not large enough to cause instability but which are 
large enough so that the algorithm CAl will be unable 
to match the reference model, (thus defeating the 
entire philosophy of model reference adaptive control) . 


3*3.6 Analysis of Higher Order Systems XJsing CAl 

The linearization technique which was used on nominally first order 
systems is now extended to high order systems. The adaptive controller 
is designed assuming that the plant has n poles and m=n-l zeroes, so 
that the relative degree of the system is assumed to be n*=l, allowing 
the use of CAl. The system is then analyzed using the actual plant. 


g B 


, which contains unmodeled dynamics as well as the nominal system. 


‘ .. * r ;o. 
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The error system is shown in Figure 2-3 and the relevant equations 
appear in Table 2-1. 

As in the first-order case of Sections 3c 3.2 and 3.3.4 the 
analysis consists of first linearizing the adaptive system around 
some nominal set of parameters and signals. 

Assume that 



y(t) = 

y*(t) + £y(t) 

(3-39) 

whet 4 

y* (t) 


(3-40) 

so that 

y*(t) 

- V u 

(3-41) 

Then 

4 * 

f+ 

= w*(t) + 5w (t) 

-y -y 

(3-42) 

where 

v (t) 


(3-43) 

Also assume that 

u(t) = 

u*(t) + 5u(t) 

(3-44) 

whGre u*(t) is such 

that 




y*(t) 

g b 

= [u*(t)] 

A 

(3-45) 

Then 

wj ( t) 

= w*(t) + 5w (t) 
— u -u 

(3-46) 
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Linearizing the error system of Figure 2-2 around w*(t), k*(t) 
simply replaces u(t) with w* (t) . Further assuming that the 
reference input ,r, is constant, so that y* is constant and w* is 
constant allows the error system to be manipulated into the form of 
Figure 3-13. Remembering that the magnitude of the scalar 

yd* - w^* £ w* > 0 (3-47) 

is controlled by the magnitude of r and, therefore, that yd‘ : 
can assume any value, one is led to the following theorem. 

Theorem 3.1 ; The algorithm of CAl is globally asymptotically 

. q*B* 

stable only if there exists a k such that is positive real. 

Proof: For the nonlinear error system to be globally asymptotically 

stable, the linearized error system of Figure 3-13 must be asymptotically 

* *T * 

stable for all values of d = w T_ w . Note first that if A* has 
unstable poles, there exists a d* small enough so that the system of 
Figure 3-12 is unstable. If A* is stable, the Nyquist Criterion shows 
that, in order for the system to be stable for all d*, the Nyquist plot 
q*B* 

of must never cross the negative real axis; for this to be 

iC A S 

r 

g*B* 

true, the Nyquist plot of — -y- must never cross into the left-half 
g*B* 

plane so that must necessarily be positive real. 


■ » t # » Y V'- * ■ '•***> m-htmr v«. ,'#• iiy. 
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Figure 3-13. Linearized error system of CA1 with w constant 
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Remark 1 ; There are many proofs, e.g. [ 3-6 ], of the sufficiency 

of a positive real condition for global asynyptotic stability of 

** i0 % 

adaptive control algorithms. This is the first proof of the 
necessity of this condition. 

Remark 2 ; From eqn. (2-22) it is seen that the relative degree of 
q*B* 

■■ 1 n — is equal to the relative degree of the plant. Thus the plant 
A 

must have relative degree equal to 0,1, or -1 in order to have 
global asymptotic stability. This will not occur for physically 
realizable plants since physically realizable plants must be of 

at least relative degree two to satisfy the Horowitz criteria I 64 J . 

Besides showing that there are some inputs for which global 
asymptotic stability is lost, the analysis leading to Figure 3-13 also 
can be used for a local analysis of the behavior of the adaptive system 
with constant inputs as did the specific analysis, performed earlier in 
this section, for a first order plant. In fact, Figure 3-13 provides 
the basis for the generalization of the d*-root locus analysis con- 
sidered earlier. This analysis will include the CAl adaptive system 
where the design is carried out as if the plant has relative degree 
equal to one, while, in actuality t the real plant consists of a relative 
degree one system in series with a set of stable unmodeled dynamics. 


It can be seen from Figure 3-13, eqn. (3-47) and the definition 
of w from Table 2-1 that the gain of the error system loop of CAl 
is roughly proportional to the square of the magnitude of the reference 
input. It is when the gain of the error loop becomes large that the 
bandwidth of the error system becomes large, and the unmodeled dynamics of the 
nominally controlled system can become excited, causing instability. 

The gain of the error system loop could be set independently of the 
size of the reference input, if the adaptation gain matrix of eqn. 

(3-47) were made to contain a normalising factor , such as 

r<t) = — * I; Y>0 

w (t)w(t) 

Such a normalizing factor would allow the prudent system designer, 

with some knowledge about the unmodeled dynamics present in the plant, 

to design a linearized error loop gain which would maintain stability 

for all constant reference inputs, if there were no disturbances.* 

Unfortunately, the stability proof of CAl does not allow for such 

time-varying adaptation gain matrices. Algorithms CA3 and CA4 do include 

such a normalizing factor and have much improved stability properties 

for constant reference inputs and no disturbances, as will be seen in 

in Section 3.5 and Section 3.6. 

_ 

The case where more general reference inputs and disturbances are 
allowed does not allow for such a simple modification to improve 
stability properties, as will be seen in Chapter 4. 
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3.3.7 Numerical Example with Nonrainimum Phase High Frequency 
Unmodeled Dynamics 

The following example illustrates the use of this analysis when 
the unmodeled dynamics are non-minimum phase. This is of interest 
since such unmodeled dynamics may represent time delays, it is also 
of interest since now Assumption A2 of Section 2.2.1, as well as 
Assumption A3, is violated by the unmcdeled dynamics. 

Consider the same first order system considered in Section 3.3.3, 
given by eqn. (3-19) but let the plant include unmodeled dynamics 
represented as: 


= - (s-10) 

u (s+10) 


(3-48) 


The system (3-48) happens to be a first order Pade approximation 
of a 0.2 second time delay, but it will be considered here for its 
own sake as a non-minimum phase system. (Time delays can be handled 
directly from Figure 3-13 by use of Nyquist concepts or direct 
transfer function calculations) . 

The actual plant is then described by 

-2 (s-10) 

(s+1) (s+10) 


Ie! 

A 


(3-49) 
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while. the model is given by: 
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g B 

M 


m 


3 

(s+3) 


(3-50) 


With the degrees of freedom that we have, the relative . degree 
n*“i assumption allows us to define the nominal controlled plant. 


g*B* 

V" = 


-2k* (s-10) 
s 2 +lls+10+2k*(s-10) 

y 


(3-51) 


The k*-root locus for the desired system appear in Figure 3-14. 

The d*-root locus is shown in Figure 3-15 starting with the "desired" 
poles represented by boxes on Figure 3-14. 

As was the case in the example of Section 3. 3. 5, the nominal 
£ ystem which is "desired" to closely match the model may lead to an 
unstable error system whereas another nominal system may have stable 
error dynamics. In order to predict instability, one must find a 
value t f d* for which no nominal system is stable. The poles of the 
linearized error system shown in Figure 3-13 are derived from that 
figure using eqn. (3-51) : 

s 3 + (ll+2k*)s 2 + (10-20k*-2d*)s + 20d*=0 (3-52) 

y y 

Performing the Routh-Hurwitz test on eqn. (3-52) shows that 
all linearizations will be unstable independent of k* and k* if 


d* > 11.7 


(3-53) 
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Figure 3-14. 



root locus of eqn. (3-51) . 
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The value of d* given in eqn. (3-53) can be translated into the 
value of reference input r for which there will be no values of 
k* and k* which can produce a stable linearization. The. eqn. (3-47) 
and the condition Y^l, shows that the value of r corresponding to 
eqn. (3-53) is 


r >2.4 

If the Value, d*-11.7 is used, eqn. (3-52) shows that a stable 
linearization is produced only if 


ky » -3.1 

Figure 3-16 shows the results of a simulation run with r=l. 0. 

The parameters converge to k* = -.3, k* « .8 and the error system 
shows a characteristics frequency of tu«2.1 rad/sec. as predicted by 
eqn. (3-50) with the above value for k* and d*=2. 

Figure 3-17 shows the results of a simulation with r=2.0. This 
value of r is getting close to one for which there is no stable 
linearization. Note how after the initial non-minimum phase behavior 
the parameters rapidly settle to levels which will maintain stability. 
The parameter k* cannot converge to the value k* =* -0.54 which 
would make the controlled plant match the model because for this 
large a reference input the 1 nearization around k* = -0.54 is 
unstable. Naturally the oscillation frequency of the error system is 
much higher in this case as the linearization predicts. 





* 4.0 
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Figure 3-17. Simulation of CA1 with non-minimum phase 
unmodeled dynamics and r=2.0. 
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In attempting to simulate the system close to the stability 
limit of r=2.4 ,it was found that the system went unstable during 
the large overshoot in the transient phase not covered by the linear- 
ization. When the initial parameters were picked to be closer to 
what must be their final values if the system is to converge, the 
linearization technique predicted the behavior well. Figure 3-18 
shows the results of a simulation with r=2.3 and the initial values 
of the parameters, k^ = -2.0 and k^ = 2.5. The simulation shows 
that there is indeed a stable linearization possible with r=2.3. 

This experience with the simulation converging for some initial 
values of parameters but not for other values of the parameters reminds 
us that the analysis used here is a local analysis . By the existence 
of an unstable linearization we may conclude that the system cannot 
converge to the parameter and signal values around which the linear- 
ization was made; however, by the existence of a stable linearization we 
may not conclude that the system will indeed converge to the parameter 
and signal values around which the linearization was made, because the 
system may never enter the subset of parameter and signal space around 
which the linearization is valid. Thus the linearization analysis of 
this chapter may be used to determine possible situations of poor 
behavior but it cannot ensure good behavior for the non-linear adaptive 


system. 
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From the example of this subsection, we have seen that the 
linearization-based analysis can be extended to include cases where 
the unmodeled dynamics of the plant include non-minimum phase 
characteristics and the results in this case are very similar to 
the results when the unmodeled dynamics are minimum phase. 

3.3.8 Summary of Section 3.3 on CAl 

In Section 3.3, we have shown that the linearization technique 
introduced in Section 3.2 is a valuable tool in the study of algo- 
rithm CAl when the reference input is constant and there are no 
disturbances. The linearization analysis, verified by simulation 
leads us to the following conclusion about CAl: 

• Even when the plant model upon which the adaptive 
design is based is a perfect description of the 
plant dynamics, large constant reference inputs 
may cause high frequency control activity. 

• When there are unmodeled dynamics present in the 
plant, large constant reference inputs may cause 
the algorithm CAl to be unable to perform its main 
task of following a change in reference input in the 
same manner that a reference model does. As the 
reference input further increases, instability may 


result 
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• The two properties mentioned above cure caused by 
the fact that the error loop <iain and thus the 
bandwidth of the error loop increases with in- 
creasing reference input. It is not allowable 
within the constraints of the CA1 algorithm to 
counteract the increasing error loop gain by 
including a normalizing factor in the adaptation 


gain matrix. 
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3.4 Analysis of CA2 
3.4.1 Introduction 

In this section, the linearization analysis which was introduced 
in Section 3.2 and applied to algorithm CA1 in Section 3.3, will be 
used to investigate algorithm CA2. The major difference in the 
stability analysis between algorithms CAl and CA2 is due to the 
added feedback loop in CA2 as shown in Figure 2-7. This inner loop 
feeds the auxiliary errpr signal, €(t), back through a gain, 

pv T (tjr v ( t) , 

where p is a positive constant chosen by the designer, and then back 
to €<t) through the positive real system. 


V 

The additional loop was included in CA2 in order that the first 
derivative of the adjustable parameter be square integrable, 
satisfying a technical condition in the stability proof [5] . From the 
analysis of this section, we will be able to make the following 
conclusions about CA2 : 

• The inner error loop provides the designer with a 
parameter, p, with which he cam tradeoff improved 
stability properties in the presence of unmodeled 
dynamics against the speed of adaptation. 
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• The algorithm CA 2 can, for a specific set of 
unmodeled dynamics, be made to have a stable 
linearized error system for all values of constant 
reference inputs. 

• By selecting the value of p conservatively, the 
algorithm CA2 can be made to have stable linear- 
ized error systems for all constant reference 
inputs in the presence of a wide range of unmodeled 
dynamics. However, a conservative choice of p 
will cause the adaptive system to adapt very 
slowly. 

It is important to remember that the existence of stable linear- 
ized error systems for all constant reference inputs does not 
guarantee that the non-linear error system will be stable for cons- 
tant references inputs . Instabilities may still result if the 
initial values of the parameters and signals in the system are too 


far from the values about which the linearization is performed. 



-191- 


ORfGINAL PAGE 13 
OF POOR QUALITY 


3.4.2 Unity Relative Degree Analysis 

We consider the special case of CA2 where the adaptive controller 
is designed assuming that the relative degree of the plant is unity, 
i.e., n*=l. It cam be seen from Figure 2-7 and the equations of 

Table 2-3 that in this case CA2 differs from CAl only in the additions 
of an inner feedback loop in the error system. 


3. 4. 2.1 The Linearized Error System 

Using the same technique of linearization with constant input as 
in Section 3.3, the error system is reduced to that of Figure 3-l9a. 

In Figure 3- 19b, the system is redrawn, incorporating the usual 
definition 

yd* = w T £ w* (3-54) 


and showing that, for constant inputs, the effect of the additional 

? *B* 

from CAl, with 


S E ~ 


g*B* 

k_A*s 


Pg M B M 

a m 


g * B *v pg M k iv* s 

k £ A ‘v 


(3-55) 


ir the linearized error feedback loop. 


3. 4. 2, 2 Discussion of the Inner Loop 

There are two important properties of the inner loop of 
Figure S-lSajWhich give rise to the second term in eqh. (3-55). 


1) There is no integrator in the inner loop. 
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2 with constant input and 





Even in the case where there are no unmodeled dynamics, the 
outer loop of Figure 3-18a which CA2 has in common with C&l must 
have a loop transfer function with a pole excess of at least two- 
one from the nominal controlled plant and one from the integrator. 

The proportional feedback term of the inner loop will give rise 
to a zero in the error system which was not present in the solely 
integral loop of CAl. 

2. The inner loop does not feedback through the 
nominal controlled plant which contains un- 
modeled dynamics but it feeds back through the model. 

Since the model is chosen to have relative degree of unity, the 
system, S of eqn. (3-55) and Figure 3-19b will have relative degree 
of unity. Therefore, the system will not become unstable due to a 
large gain. 

Indeed, the model is chosen to be positive real. For any given 

g*B* 

nominal control system, ■ , p can be chosen large enough so that 

Jv n 

r 

the second term of eqn. (3-55) will dominate the first tern to the 
point that tb* System of Figure 3-19b will be stable for any constant 
d*. In practice, this means that, by choosing p large enough, the 
linearized error system can be made stable for a large class of 
unmodeled dynamics and a large class of constant reference inputs. 
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It is important to notice* however, that the increased ability to maintain 
stability in the presence of unmodeled dynamics attained by increasing 
p is not attained without a tradeoff. As p increases, the size of the 
error becomes smaller for any nominal control system due to the larger 
inner loop gain. From Figure 3- 19a we can derive that 



The signal €' (t) reflects how well the plant is matching the 
model. The above equation shows that as p increases the signal 
e(t) which drives the adaptation mechanism becomes small even if the 
actual error represented by €' (t) is large. Thus, large values of 
p will cause slow adaptation. 


3.4.3 A First Order System with No Unmodeled Dynamics 
3. 4. 3.1 Analysis 

Examine first the case where the plant is really first order 
so that Assumption A3 is satisfied and the model is 


q B 
y M M 


M 




s+a, 


M 


(3-56) 
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Then — can be made equal Linearizing about 

this nominal system yields. 
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The characteristic equation of the error System is: 


2 , + yd 1 

3 + v 


(v s+ ^) 


(3-58) 


The d*-root locus now contains a zero, whose location can be 
controlled by p, using some a priori knowledge of g^. The zero 
is located at 


-i . :i 

9 m p 


(3-59) 


A typical d*-root locus of eqn. (?•*$-%) is shown in Figure 3-20. 

Note that as p is increased, the controlled by p moves toward 

the origin and the problem of high frequency oscillations in the 
error system and the plant input is alleviated. However, as p is 
increased, it begins to limit the speed of response of the error 
system, because, as the zero moves close to the origin, a pole of the 
error system will then be trapped near the origin producing an 
extremely sluggish adaptation mechanism. It is important to stress 
that the zero controlled by p is not a transmission zero of the error 
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system which can cancel an error system pole. Rather, it is a 
zero only in the context of determining the d*-root locus of 
eqn. (3-58) . 

3. 4. 2. 2. Numerical Example with No Unmodeled Dynamics 

The example of Section 3.3.3 was simulated using the algorithm 
CA2 with p=.13. For this example, this value of p places the 
d*-root locus zero at about s=-5, so that the locus is as in 
Figure 3-20. The result where r=2.5 is shown in Figure 3-21. 

Compared with Figures 3-2 and 3-3 the system oscilates more 
slowly and is better damped as expected from the analysis. Figure 
J-22 shows that when the input is turned up to r*=5. 0 , the system 
behaves better rather than worse, particularly in contrast to what 
it did in Figure 3-4 as explained from the position of the poles in 
the error system in the d*-root locus of Figure 3-20. 


page is 
Quality 


3.4.4 A First Order System with Unmodeled Dynamics 
3. 4. 4.1 Analysis 

When there are unmodeled dynamics in the plant, the poles of the 
linearized error system are determined by the characteristic 
equation upon which a d*-root locus can be performed 

(3-60) 


A A M s + Y d pg M I B M A s + 


| B A*s + ^ B*A J =0 

Ml M pg M 
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Figure 3-22. 


Simulation of CA2 with r=5.0. 
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The zeroes of the first term of eqn. (3-60) are the poles of 
the d*-root locus. The zeroes of the d*-root locus are found by 
finding the solutions of , •* ■ - 


b m r * s 


+ 




(3-61) 


The effects of the choice of p upon the zeroes of the d*-root 
locus can be investigated by performing a root locus on eqn. (3-61) 
using p (or, equivalently, 1/p) as a parameter. 

Through these root locus techniques the designer is guided 
how to choose the parameter p in order to maintain stability in the 
presence of a specific set of unroodeled dynamics provided that the 
system is in the neighborhood of a specific linearization point. 

The designer must use engineering judgement in applying the root 
locus techniques to a number of different sets of unmodeled dynamics 
and to analyze each around a number of linearization points so that 
the behavior of the algorithm is understood for all possible sets of 
unmodeled dynamics and operating points. 
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3. 4. 4. 2 Numerical Example with Unmodeled Dynamics 

The example with unmodeled poles from Section 3.3.5 is now 
repeated using CA2. First p is picked to give favorable zero 
positions in the d*-root locus. The 1/p-root locus of eqn. (3-61) 
is shown in Figure 3-23. Note that there will be zeroes in the 
right-half plane if — is too large (p too small) . Using Figure 3-23 
p is picked to be 


p = .5 

which places the zeroes of the d*-root locus at 

s=-3 . 67 , s=-4.57, s=-20; s=-2. 71 

Note that a designer would not know exactly where the unmodeled 
poles lie and would thus have to estimate a reasonable value for p. 

The d*-root locus is then given in Figure 3-24. 

The error system should be stable for all values of d* and 
should be dominated by the pole which lies between zero and -2.71. 

Figure 3-25 shows the output of a simulation with r=5.Q. Remember 
that such an input drove the CAl algorithm unstable. Here the system 
is not only stable but well behaved. Similar results were achieved 
with r=50.0. 

Thus, we have seen that by including an additional feedback loop 
in the error system, the algorithm CA2 can, if its parameters are chosen 
correctly, remain stable and well behaved for all constant inputs even 
in the presence of some unmodeled dynamics. 



-2 


X poles when p=0.0 


O pole of A m 
D poles when p=0.5 


Figure 3 23. --root locus for numerical example of Section 3. 4. 4. 2. 
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Figure 3-24. 


d -root locus for example of Section 3.4.4 


.2 with p=0. 5. 
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3.4.5 Analysis of CA2 for Higher Order Systems 

The analysis of CA2 will now completed for the case where the 
control system is designed for a plant with relative degree 
greater than unity ( n *>l). Linearization is still the tool used 
and the reference input again will be assumed constant. The 
equations of Table 2-2 and Figure 2-6 then apply. 

The linearization proceeds as in the n**l case. Let 


w(t) = w* + 6w(t) (3-63) 

v(t) = v* + 6v(t) (3-64) 

with w* defined as it was in eqns. (3-39)- (3-46) of Section 3.3.6 
ami v* the output of eqn. (2-34) using w* as an input. Also assume 

k(t) » k* + k(t) (3-65) 

h(t) = h* + h(t) (3-66) 


and that all errors and perturbations are small. Recall 
eqr.. (2-41) repeated below: 


Il> It) = I ^ T (t)w(t)J - k T (t)v(t) 


(2-41) 


which, when linearized becomes 
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This shows that \p is small when k is small so that the 

h<JJ term in Figure 2-6 is of second order and, hence, does not 

appear in the linearization. The rest of Figure 2-6 survives the 

linearization intact with w* and v* replacing w and v. 

M 

Assume further, without loss of generality, that — has unity 

L 

d.c. gain. Then, from eqn. (2-34), if w* is constant 

v* = w* (3-68) 


Also using the assumption that w* is constant and setting 
- yi for simplicity. Figure 2-6 is reduced to Figure 3-26. 

Notice that again the d*-root locus will have one less zero than 

g B L 
n M 

pole since - is chosen to have relative degree equal to 

unity. Also, since ~ — is chosen to Joe positive real, the 

W 


parameter p can, as in the n*=l case, be chosen large enough so that 
the positive real term will dominate the error loop and the loop will 
be stable for all values of constant reference input. Again, as in the 
n*=l case, too large a choice of p will cause the error to be small 
and insensitive to parameter changes so that the adaptation will be 


slow 



- r; 



Figure 3-26. Linearized error system for CA2 with constant w 
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3.4.6 Conclusion 

We have demonstrated analytically that the algorithm CA2 con- 
tains a parameter, p, by which the designer of the adaptive system 
can trade off improved stability properties in the presence of 
unroodeled dynamics against the speed of adaptation achieved. 

The analysis method presented aids the designer in establishing 
how large p must be for the linearized error system to be stable 
for a specific set of unmodeled dynamics, a specific point of 
linearization and a range of constant reference inputs. It also 
provides information on how fast the adaptation mechanism will react 
under such specific conditions by displaying the poles of the 
linearized error system. The designer must couple this tool with 
engineering judgement, if he is to create a system which will perform 
satisfactorily in the presence of any possible umnodeled dynamics, 
at all possible operating points and for all constant reference inputs. 

We stress here that none of the linearized analysis in this 
section can ensure stability . Also, all the analysis was performed 
assuming constant reference inputs and no disturbances . More general 
reference inputs and arbitrary disturbances can cause instabilities 
as will be seen in Chapter 4. 
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3.5 The Analysis of CA3 
3.5.1 Introduction 

As was mentioned in the discussion of Section 3.3.6, it is 
desirable to have a time-varying adaptation gain of the form 


v (t) 


Y . 

X +Y'd*(t) 
o 


(3-62)* 


* *T 

where d (t) = w (t)w*(t), to enable the designer to approximately 
place the poles of the linearized error system independently of 
the size of the signals in the system. Such a gain is not allowed 
in CAl or CA2 due to the nature of the associated stability proofs. 

Luckily, normalizing gains of the type given by eqn. (3-62) in 
the adaptation process are suggested by various identification 
schemes such as least squares and stochastic approximation (65 J . 

As a result, adaptive control algorithms have been developed using 
such a normalizing factor and it can be seen from eqn. (2-49) that 
CA3 is such an algorithm. The normalizing factor of eqn. (3-62) 
provides control of how far along the d*-root locus the poles of the 
error system can travel. This establishes the region in which the 
poles of the linearized error system can lie ; again under the assump- 
tion that only constant inputs are applied. 

*The parameters y and "y T control the nominal size of the gain while 
the parameter is present to avoid possible division by zero. 
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In order to incorporate the normalization factor of eqn. 

(3-62) into a stability proof for CA3, two change* are made in the 
CA2 algorithm. The inner loop of the error system shown in Fig. 2-7 

r 

is removed and the auxiliary filter with transfer function — is 

chosen so that ~ has unity d.c. gain and so that 
M 

g M B M L 

" is a constant memoryless system. With this realization* the 

V 

auxiliary signal loop is present even when n*-l and, furthermore , it 
takes the place of the inner loop of CA2 shown in Figure 2-7 in 
placing zeroes of the d^-root locus. 


3.5.2 Analysis 

Proceeding with the exact same linearization-constant input 
analysis as in Section 3.2, Figure 2-8 is reduced to Figure 3-27 
where 


and 


■yd* » w* T £ w* 
Y'd* *» w* T £* w* 


(3-63) 


(3-64) 


The new parameter matrix, P , is a weighting matrix providing extra 
flexibility over the normalization factor of eqn. (3-62) . 

The linearized analysis proceeds as usual except that, for this 
algorithm, the gain of the d*-root locus 1st 

Yd* 

X 0 +Y'd" 


(3-65) 
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When the reference input is large so that y'd* > \ q the gain of 
the d*-root locus given by eqn. (3-65) will not itself become 
large but will saturate at the value ^7- . The quantity ^7 

is picked by the designer so that he can control how far along the 
d*-root locus the poles of the linearized error system can travel, in 
a maimer independent of the magnitude of the constant reference input. 

3.5.3 A Numerical Example with Unroodeled Poles 

The example of Section 3.3.5 with an unmodeled pole pair is 
considered here for CA3. The plant is given by 

y(t> - -fr- W (t)I (3-27) 

8+1 \ s 2 +30s+229 / 

with the usual model described by: 

y H (t) * ife !r(t)! (3 * 28 > 

When the linearization is performed around 

k* = 1.14 k* = -0.65 h* ■ .88 

r y 

. g*B* 

a point m the parameter space where the --- f - of eqn. (2-118) 

A 

system nearly matches the model, the system d*-root locus 
is obtained from Figure 3-27 with 
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h \»M 





(3-66) 


The d*-root locus for this system is shown in Figure 3-28. 

The normalized adaptation gain of eqn. (3-62) is not actually needed 
here for stability although it could be used to keep the linearized 
error system from becoming oscillatory. 

Figure 3-29 shows the results of a simulation with r=10.0 
and —(■ -1.0 Figure 3-30 shows the results of a simulation with 

r=10. 0 and = 0.3 . We notice from Figure 3-30 that the lower 

gain in the d*-root locus slows down the system and increases its 
deunping. The same results occurred with r=50.0 in both cases. This 
is not surprising, since the d*-root locus gain remains at 
approximately . 

When simulations were tried with r=100.0,both systems became 
unstable during the initial transient period. This reinforces the 
fact that the linearized analysis used throughout this chapter is a 
local analysis. If either the parameters or the signals in w(t) are 
too far from the values around which the linearization is performed. 






Figure 3-28. d*-root locus for numerical example of Section 3.5.3. 
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the results of the linearization analysis may not be valid. Thus, 
all the results of this chapter based upon the linearization 
technique must be validated by simulation. 

3.5.4 Conclusion s 

It has been shown in Section 3.5 with the use of linearization 
techniques that with the normalization of the adaptation gain as 
given in eqn. (3-62) and the proper setting of the parameters in 
this gain, the algorithm CA3 can be designed so that the linearized 
error system is stable for all constant reference inputs in the 

presence of a specific set of unmodeled dynamics, in addition, the 
poles of the linearized error system can be positioned at 

a point along the d*-root locus for a large range of constant 
reference inputs. 

Although the linearized analysis is a local analysis which can- 
not guarantee global stability, simulations indicate that there 
is a reasonably large range of values for which the linearized 
analysis provides an accurate prediction of the adaptive system 


behavior 


3,6 The Analysis of CA4 
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3,6.1 Introduction and Development of the Linearized Error System 

The final continuous-time algorithm analyzed in this dissertation 
is the CA4 algorithm of Egardt £ 11). As was mentioned in Section 
2.2.4, this algorithm uses extra filtering in the control loop 
(see Figure 2-10). 

The algorithm is analyzed by linearizing the error system of 
the algorithm about a nominal set of parameters and constant signals 
w* produced by a constant reference input. Linearizing the error 
system of Figure 2-11 produces the system of Figure 3-31* In the 
special case when n*=l,the error system of Figure 2-12 applies and 
the linearization of this system produces the system of Figure 3-32. 

Notice that the algorithm CA4 does include a normalizing factor 
in the gain as given by eqn. (2-58). This produces the d*-root 
locus gain which is the same as in CA3, given by eqn. (3-62) 

g d* (t) = I+y’d*(t) (3-62) 

as shown in Figures 3-31 and 3-32. Such a gain allows the designer 
to control the placement of the poles of the linearized error 
system over a wide range of constant reference inputs. The 
situation is similar to that discussed in Section 3.5.2. 
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3.6,2 The Casa n*«l 

first* examine fch$ algorithm for the case n***l. Note that in 
this case the inner loop of figure 2-11 is not used ,»o there is no 
way to place xeroaa of the d*-root locus. The algorithm of CM 
is an improvement over CA1 both in the normalising factor limiting 
the gain of the d*»root locus and in the fact that, wit)' the added 
filtering* the nominal controlled plant* , of etjn. (2-63) 

will have a relative degree that is one leas than the relative 
degree of the corresponding nominal controlled plant of CM given 
in eqn. (2-23), Here, from eqn. (2-64) , it can be seen that 

It- 'A 

*~“r“ can be made to be a memoryless system. The cl* -root locus will 
have a pole excess of one and thus no oscillatory high frequency 
error signals can result. 

When there are unmodeled dynamics ^ will have the same pole 

excess as the unmodeled dynamics. If this pole excess is greater 
than one, the d*-root locus of the linearised error system will 
exhibit a Butterworth pattern of order three or greater causing the 
linearised error system to be unstable* if the d*-root locus gain is 
allowed to become too large. This situation is worse than the 
situation of CA3 where the pole excess of the d*-root locus is one* 
independent of the unmodeled dynamics. 



* a 
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3.6,3 The Case n*> 1 

When the adaptive control system CM is designed for a plant 
with n*>l, the inner loop of Figure 2-H is now present and the 
error loop of the d*-roofc locus given in Figure 3-31 will have a 

t 

single pole excess independent of the relative degree of the 
unmodeled dynamics, This is similar to the situation of CA3. 
whether or not the seroes of the d*-root locus will be such th&'t the 
linearised error system remains stable for all values of the 
d*-root locus gain is something that must be determined by analysing 
each case individually. If necessary, the normalisation of the gain 
of eqn. (3-62) can limit the dist<ince that the poles travel along the 
d*-root locus. 


3.6.4 A numerical Example with Unmodoled Dynamics 

The usual example of Section 3.3.5 with an unmodeled pole pair 
is carried out for CA4. The filter used was 



(3-67) 


The d*-root locus gain was allowed to saturate at unity ( «1 

in the notation of Section 3.3). Figure 3-33 shows the results 
when r*»5.0. Curves of the exact same shape were obtained for r»10.0 t 
since in both cases the d*-root locus gain was near one. 
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When the system was simulated with r«=50.0, we observed a, bad 
transient similar to the one which caused instability in CA3 when 
too large a reference input was used in that adaptive system. 

The results are shown in Figure 3-34. The system is driven by the 
overshoot to a point in the parameter space far beyond what could 
be a reasonable desired parameter set. (Here, the desired parameter 
which would let the nominal controlled plant of eqn. (2-63) match 
the model as closely as possible is k* - -0.65). Fortunately, for 
CA4, in this case, the parameters manage to stay in a region where 
the linearized error system still remains stable. In the simulation 
of Figure 3-34 the parameters converge to n “7.4 , k* * 2.6 
which result in a d*-root locus system of 


g*B* 458 

A* s (s+27. 4) (s+1. 8+jll. 3) (s+1- 8-jll.3) 


(3-68) 


The normalized d*-root locus gain kept the error system 
stable even at these high signal levels so that the system could 
converge after the transient had died down. If the reference input 
used is increased to r=100, the transient drives the parameter into • 
a region where even the linearized system with normalized gains is 
unstable. Recovery is then hopeless. 
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In this subsection, it has been shown in the context of CA4 

’’ 4 ~ , " 'ST j ' 

that oven when the error system is stable for all values of 
refer once input when linearised around a set of desired parameters, 
normalised adaptation gains are still useful in enhancing its 
robustness when the system is driven into an undesirable region 
by the transient phase. 

3.7 Conclusions 

It has boon shown in this chapter that linearisation techniques 
arc useful for the study of the behavior of continuous-time adaptive 
control algorithms when such algorithms are implemented in the 
presence of unmodeled dynamics under constant reference inputs with 
no disturbances. 

Using this technique various general properties of the algorithms 
CAl to CA4 have been displayed, 

• In Section 3.3.0 it was shown that the gain and 
bandwidth of the error system loop of CAl depend 
upon the magnitude of the reference inputs. In 
the presence of unmodoled dynamics, a large 
bandwidth can cause instability. 

• A modification in CA2 provides for an inner loop in 
the error system. As described in Section 3. 4. 2. 2, 
a gain parameter, p, in the inner loop allows the 
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designer of the adaptive system to create a situation 
where the linearized error system of CA2 is stable 
for a wide range of unmodeled dynamics and a wide 
range of values of constant reference inputs. The 
increased stability in the presence of unmodeled dynamics 
is attained at the expense of slowing down the 
adaptation mechanism. 

• In algorithms CA3 and CA4 ) the adaptation gain is 
normalized as in eqn. (3-62) . This enables the 
designer of the adaptive system to achieve the 
increased stability in the presence of unmodeled 
dynamics versus a speed of adaptation tradeoff by 
controlling the placement of poles of the linearized 
error system on the, d*-root locus. 

Although the linearization technique provides valuable insights 
into the behavior of the adaptive systems, it does have the following 
limitations : 

• As a linearization technique, the method can produce 
only local stability results, as discussed in 
Section 3.2. Results from the analysis are valid 
only for values of parameters and signals near those 
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used for the linearization. Results of the linearized 
analysis must be verified by simulation. An example 
demonstrating the limits of the linearization is 
discussed in Section 3.6.4. 

• The technique of this chapter provides a method for 
analyzing a system implemented in the presence 
of a specific set of unmodeled dynamics. Engineering 
judgement must be exercised to use this analysis for a 
number of sets of unmodeled dynamics and, thus, create 
a system that will perform acceptably in the presence 
of any possible unmodeled dynamics. 

Finally , we iterate that the analysis of the chapter is concerned 
only with constant reference inputs and no disturbances. It will be semi 
in Chapter 4 that even a system designed to maintain stability for 
constant reference inputs will be unstable in the presence of 
unmodeled dynamics, when excited with certain sinusoidal reference 
inputs or with constant or sinusoidal disturbances. 
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CHAPTER 4 

THE RESPONSE OF CONTINUOUS-TIME ADAPTIVE CONTROL SYSTEMS 
TO SINUSOIDAL REFERENCE INPUTS AND DISTURBANCES 

4.1 Introduction 

In the last chapter, it was shown that, with a proper choice of 
the design parameters, the continuous-time adaptive algorithms CA2- 
CA4 could be made to be locally stable in the presence of a large 
class of unmodeled dynamics provided that the reference inputs are 
kept cons tant and no disturbances are allowed. 

In this chapter we analyze the response of the algorithms CAl- 
CA4 to sinusoidal reference inputs and to deterministic disturbances 
in the presence of unmodeled dynamics. The following conclusions can 
be drawn from the contents of this chapter: 

• All of the algorithms CA1-CA4 contain an infinite 
gain operator in their error system. This 
infinite gain operator gives rise to two mechanisms 
of possible instability when sinusoidal reference 
inputs and disturbances are present along with 
unmodeled dynamics, 

• In the presence of unmodeled dynamics, the adaptive 
systems CA1-CA4 do become unstable if sinusoidal 
reference inputs at certain frequencies are introduced. 
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• In the presence of unmodeled dynamics, the adap- 
tive systems CA1-CA4 become unstable in the 
presence of even a small sinusoidal disturbance of 
any frequency. 

The results of the chapter are developed as follows: 

Section 4.2 describes the infinite gain operators present in the 
error loops of the algorithms. In Section 4.2.4, it is argued that 
these infinite gain operators are generic to the adaptive control 
problem. Such infinite gaits are usually handled in stability proofs 
by assuming the high frequency phase properties of the plant are 
known. These phase properties can then be used to stabilize the 
error system. However, it is the high frequency phase properties of 
a plant that are most affected by unmodeled dynamics. Section 4.3 
shows two mechanisms for instability of the adaptive control system in 
the presence of unmodeled dynamics. 

In Section 4.3.2 the first mechanism for instability in the adap- 
tive algoritluns is given. This mechanism uses the combination of 
the infinite gain operator and the phase shift introduced by the 
unmodeled dynamics to produce instability. 

In Section 4.3.3, the second instability mechanism is explained. 
This mechanism occurs when there is a steady output error due to 
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either a disturbance or a controlled plant-model mismatch at some 
frequency. Such instabilities are usually ruled out in the pub- 
lished stability proofs by assuming that the controlled plant has 
no unmodeled dynamics and that it can match the model perfectly; 
it is furthermore assumed that no disturbances are present. 

Sectior 4.4 shows, through digital simulations, that the 
adaptive systems (CA1-CA4) do indeed become unstable when faced 
with certain combinations of sinusoidal reference inputs and 
uniodel-id dynamics. The instabilities arise in the manner predic- 
ted by the analysis of Section 4.3. 

Section 4.5 shows that, even though the stability problems 
of Section 4.4 are caused by the presence of a high frequency 
output error signal, the use of additional filters on the plant 
output or output error do not alleviate the problem. The filters, 
themselves, lower the frequency of the output error which is 
necessary to produce instability. 

Section 4.6 presents the most damaging of all evidence for the adap- 
tive control algorithms CA1-CA4. in Section 4.6 it is verified 
by digital simulation that, for a large class of unmodeled dynamics, 
the adaptive controllers CA1-CA4 will become unstable in the presence 
of a small amplitude sinusoidal disturbance of any frequency. While 
a designer can control the reference inputs that will be introduced 



-232- 


in to his system, he has no control over what disturbances are 
present . Since sinusoidal disturbances are common in many 
applications, e.g. 60 Hz noise, these algorithms will lead to 
unstable systems. 

Section 4.7 summarizes the conclusions of this chapter. 

4.2 The Infinite Gain Operator 

4.2.1 Quantitative Proof of Infinite Gain for the Operator of CAl 

The simplest adaptive control error system, that of CAl, 

appears in Figure 2-3 and is repeated here as Figure 4-1. it 

consists of a forward linear time- invariant operator representing the 

q*B* 

nominal controlled plant complete with unmodeled dynamics, rr — y , 

r A 

and a time-varying feedback operator. It is this feedback 
operator which is os immediate interest. The operator, reproduced 
in Figure 4-2 for the case where w is a scalar «*nd T=l, is para- 
meterized by the function w(t) and can be represented mathematically 

as: 

t 

u (t) = G w ( t j [e (t) ] = u(o) + w (t) j w(x)e(T)dx (4-1) 

0 

In order to make the notion of the gain of the operator 

G precise, the following operator theoretic concepts are 

w (t) 

introduced. For further development see [66]. 
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Figure 4-2. Infinite gain operator of CA1 
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* t * 

Definition 4.1 : A function £(t), from t0,«) to R is said to be Jhn 

L 2 if it is integrable and 



The quantity [ [• | | is called the norm of the function. 


Definition 4.2 : A function f (t) from I0, w ) to R is said to bo 

in if the truncated norm 


t i«<t> 1 1 


T 



f 2 {X)dT 



is finite for all finite T. 


(4-3) 


Definition 4-3 ; The gain of anoperator G[f(t)j, which takes functions 
in L 2q into functions in L 2q is defined as 


g| 


||<5tf(t)]| 


T 


sup 
f (t) 6L 


2e 


T€[Q,«>) 


L 


(4-4) 


2 


If there is no finite number satisfying eqn. (4-4) , then G is said 


to have infinite gain. 
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Thgorow 4-1 t If w is given by 

w(t) » b + c sinto^t (4-5) 

for any positive constant* b , c , U ) q the operator* of eqn. (4.1), 

C» w » has infinite gain. 

Proof t The proof consists of constructing a signal* e(t), such 
that 

l|c w Mtn||* 

lim — =- — ™ 

'i VKV) ll®(t)||J 

2 

is unbounded . 

hot e(t) ** a sinu> t 

o 

with a an arbitrary positive constant and the same constant 
as in eqn. (4.3). 

These signals produces 

1 1 

w(t)e(t) » ab sinw t + - ao - ■? ac coa 2ui t (4-7) 

o * * o 

K(t) « K o + J w(T)e(T)dT 

a k +4 act + cost) t - sin2u) t (4-8) 

o 2 ul ml o 4W o 
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u 

u(t) = G w ^[e(t)3 = u Q + w(t) J* w(t)e(T)dr * 

1 . ab 2 / 1 2 aix\ 

» u o . + j t + — + [2 ac * "srj sin V + 

/ac 2 _ abM 
\8(i) (1) / 

' n n / 


2 2 

+ — ) cosu) rt t - ~~ sin2u) t + — * cos3(i) t (4-9) 

8U) a) / 0 4 W o 8(1) o 

00 / o 


Now 1 using standard norm inequalities, we obtain 


I |u(t) ||^ >. | j-j abc t + ^ ac 2 t sinu) o t| | T - 
2 


O "L„ 


,T 


- U 


o' ' L„ 


ab 

ti) 


T 


77 ^ sinu tl 
I . 2 "“o ° *'L. 


-II ($t- 13~) “■“o t ll - I Ilf 2 Sin2(ii t| | - 

\ O o / L o 2 


-II 


— — cos3(i) t 
8(1) o 

o 


II 


>||^- abc t + ^ ac 2 t sinw t 
t & o 


11 


ic -kr 


with 




14-10) 

(4-11) 


ac 2 ab 2 ) (.3abc ac^ ^ 

8(1) ” a) ( + 1 4 o) ~ 8U) 

o 0/ l o o 


<00 


(4-12) 


and 


||a-b|| 

> 1 

I4MMI 

j |a+b| 1 

>1 

141-INI 
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Now 


| ji abc t + — ac 2 t sinw t 


o 1 ’L, 


T / 

C 2 2 2 , 


2 W 2 2 1 ‘ 24 

a b c * 3 I . a C 

12 M 2 

J 4 d) 
J 0 o 


2 4 i i 

a c .2 .2 . . a be .2 . 

— - — t sin u> t + — - — t sino) t 
4 o 2 o 


) at= 


(4.13) 



sin2u) t - 
o 


a 2 bc 3 \( 2 2 \ 

+ m ^ ' cos2 v + 2t sina, o t 

o L 


r 


i + -Sr— -V - V 2 - V 2 ‘ K c 


where 




< 00 


< OO 


t cos2u) t "1 


(4-14) 


(4-15) 


(4-16) 


(4-17) 


(4-18) 


Combining ineqs. (4-11) and (4-15) we arrive at: 

2 

/ T\ / 2 2 2 2 4 \ 

(iiu(t,iij>(?-^ + - k 2 t 2 . v . k c 


(4-16) 
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(ll e<t> lll) = * 2 / si 


sin2(i> t < a T 
o — 


(4-17) 


Therefore, 


u(t) 




(. 


2 2 2 
a b c 

12 


2 4 
a c 0) 


24 


's-)v 3 - 


■,1/2 


K 2 T 


- V - K o 




a 2 T 


and G for w as in eqn. (4-5) has infinite gain. , 

W y • «Di 

In addition to the fact that the operator G . , . from e(t) 

w(t) 

to u(t) has infinite gain, we show next that the operator, H , 
from e(t) to H(t) in Figure 4-2 has infinite gain. This operator 
is described by: 


H w(t) Ie(t)1 


- k + 
o 



w(T)e(T)dT 


(4-18) 


Theorem 4.2 : The operator with w(t) given in eqn. (4-5) has 

infinite gain. 

Proof : Choose e(t) as in eqn. (4-6)jthen k(t) - H w ^Ce(t)J 

is given by eqn. (4-8) 
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wssw 


l|ktt>||^> ll| » e Il 2 " 

iigiL-n^iL 


-Ilf “'“o 4 

o 

ill - «g— — 

^2 o 2 

(4-19) 

> ||| act li L “ (KT) 1/2 
2 


(4-20) 

where 



k ■ ( v 2 * *(?) + (% 

)' 

(4-21) 

Then 



IlKiull 1 >(| »c y ) 
L 2 

• H v ‘ 

(4-22) 

Using ineqs. (4-22) and (4-17) 



n """s , u-fr-“ «. 

(4-23) 


i Q<t) i iL 


a t 


and , hence, ll has infinite gain for w as in eqn. (4-5) Q.E.D. 
w 
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4.2.2 Qualitative Explanation of the Infinite Gain of 

G and H 
w w 

An explanation of the mechanism which results in the infinite 

gain of the operators G ... and H ... can be constructed as follows: 

w(t) w(t) 

If w(t) and e(t) contain sinusoids of the same frequency, as 

they do in eqns. (4-5) and (4-6), and if these sinusoids do not have 

a phase difference of exactly 90°, the multiplication of w(t) and 

e(t) in both G ... and H ... will produce a constant correlation 

term, the second term in eqn. (4-7). The signal w(t)e(t) is then 

integrated; the integration of this constant correlation produces the 

infinite gain. Since the integral of a constant is a ramp, the 

output signal of the integrator (which is also the output of H ,. . ) 

wit; 

increases in amplitude indefinitely with time. The output of 
G^^j is formed by multiplying the output of the integrator by w(t), 
producing a sinusoid with increasing amplitude at the frequency as- 
sumed present in w(t). 

Finally, we note that both the operators G w and will also 
be infinite gain for vectors w(t) , since the operators' infinite 
gains can arise from any component of the vector w(t) . 
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4.2.3. Thp> infinite Gain Operator for CA2, CA3 and CA4 

The infinite gain operators for CA2, CA3, and CA4 have been 
isolated from the error systems of Figures 2-8, 2-9 and 2-11 and 
appear in Figures 4-3 a,b and c respectively. Remember that each 
figure captures two operators; one from e(t) to fc(t) and one 
from e(t) to u(t). That these operators indeed have infinite gain 
will be argued by modifying the qualitative argument of Section 4.2.2. 
Mathematical proofs such as those presented for Theorem 4.1 and 4.2 
in Section 4.2.1 could be constructed for each of these operators 
but do not prove very instructive, and, hence, are omitted. 

The infinite gain operators of CA2, depicted in Figure 4- 3a 
differ from the operators of CAl only in that the first multiplica- 
tion is by T_ v(t) instead of £ w(t) . If it is assumed that v(t) 
contains a sinusoid at the same frequency, u) q , as w(t) does, then 
the infinite gain of the operators of Figure 4- 3a follows from the 
arguments of Section 4.2.2. We note that v(t) and w(t) will contain 
sinusoids of the same frequency in practice since v(t) is merely 
w{t) passed through a linear time- invariant system. 

The operators of CA3 depicted in Figure 4- 3b differ from those 

T 

of CA2 only in that there is a normalizing factor, X Q +v (t)£ v(t) , 
in the first multiplication of Figure 4- 3b. As long as the first 
multiplication produces a constant term, the following integrator 
will produce an infinite gain. 
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«(t) 


If £v(t) 



kit) 



u(t) 


W T (t) 


Figure 4- 3a. The infinite gain operator of CA2. 


e(t) 


t 


fylt) 


1 




kit) 


Xo+ vT(l)rv(t) 


^0~~ 
1i W T (t) 


Figure 4- 3b. The infinite gain operator of CA3. 



Figure 4- 3c. The infinite gain operator of CA4. 


Figure 4-3. The infinite gain operators of CA2, CA3, and CA4. 
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I£ a component of v(t) contains a dominant sinusoid at b) , 

— o 

r v(t) 

so will a component of — . This component will 

l 0 +v T (t)£' v(t) 

correlate with the sinusoid assumed present in €(t) producing the 
constant input to the integrator which will in turn generate the 
infinite gain. 

The operators of CA4 shown in Figure 4- 3c differ from the 
operators of CA3 in that the original signal w(t) has returned in 
the first multiplication replacing v(t) , a change of no consequence 
to the infinite gain nature pf the operators, and the pure inte- 
grators of the previous algorithms have been replaced by the linear 

®*o 

time- invariant operator . This operator, s *A Cs i ) ' 

has infinite gain when its input is constant. Since infinite d. c. 
gain is all that is needed of the integrators in the argument of 
Section 4.2.2, the same arguments carry forward for the system of 
Figure 4- 3c. Thus it can be concluded that the two operators for 
the CA4 algorithm shown in Figure 4- 3c are also infinite gain. 



4.2.4 The Generic Nature of the Infinite Gain Operator 
in Adaptive Control 

* 

As mentioned in Section 4.2.3, the infinite gain system of 
Figure 4-1 appears in various equivalent forms in all algorithms 
considered. Also, it should not come as a surprise that all the 
adaptive stability proofs available to date are centered around 
accomodating this operator. The following discussion is offered 
as a supportive argument to the statement that infinite gain 
operators of this type are in some sense generic to the adaptive 
control problem and its associated "learning" or "adaptation" 
mechanism. 

One of the basic premises of adaptive control is that the control 
input to the plant is synthesized via multiplication by some time- 
varying gains of feedback signals generated from the plant output 
and the plant input as in Figure 4-4, according to: 

u (t ) = k T (t) C[y(t),u(t)l (4-21) 

where C is a linear time-invariant system representing an ob- 
server or an auxiliary variable generator. The gains, k (t) , which 
will produce the desired closed- loop controller must be either 
estimated directly or derived from other estimated parameters. In 
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general, one can write for these parameters the equation: 

k(t) » M[f (t) ] (4-22) 

where M is usually a memory less map, often the identity map, as 
it is in CA1-CA4. The only information available for identification 
is the plant input, the plant output and the error between the 
plant output and either a desired or expected plant output. All 
the usual methods of parameter identification (see, e.g. ,[ 65]) 
use this information by first correlating or multiplying the output 
error with signals generated from the plant input and output by a 
linear time-invariant system; the outcome of these operations is 
represented by the vector D[y(t) ,u(t) ] in Figure 4-4. 

Since the parameter to be estimated must ideally be able to 
move towards the correct values and converge there in the absence 
further input, the correlation must be followed by an operator that 
contains an integrator, i.e. 

f(t) = P | I[e(t)D[y(t),u(t)]] (4-23) 

where F is a linear time- invariant system. 

If y(t) and e(t) consist of a dominant sinusoid of a particular 
frequency, in addition to other small signals, the system of 
Figure 4-4 can be shown to have infinite gain by the arguments of 


Section 4.2.2 


ORIGINAL FAGS S3 

OF POOR QUALITY 


We note here that Ioannou [ 52] has relaxed the requirement 
that the parameters be able to converge to match the model exactly 
and has replaced the integrator, the — of eqn. (4-23), with 

i 

s+<7 

If a is kept small, the parameters may be able to remain close 
to the desired values while the infinite gain operator of Figure 4-4 
is reduced to a high gain operator. (The gain will be proportional 
to ^ ) . The change allowed Ioannou to prove local stability of the 
modified CAl algorithm when the adaptive system is driven by low 
frequency sinusoids in the presence of unmodeled dynamics whose poles 
are at a much larger frequency than the properly modeled poles of 
the plant. Such a result is consistent with the analysis of this 
chapter . 

If a were made too large, all the variable feedback parameters 
in the nominal control system would be constantly drawn toward zero. 
Only a large output error would be able to drive the parameters 
towards their desired values. 

Thus, the adaptive system would at best settle with a large 
magnitude steady-state error. The reference model would not be 
matched at all. 


Finally i we note that; the infinite gain operator an a non- 

i 

linear system only exhibits its infinite gain for certain classes | 

of inputs and signals, w(t) , Xn particular, signals which are 

dominated by distinct sinusoids will cause infinite gain while 

signals with flat power spectrum will not. fhii can be seen by 

analysing the system of Figure 4,5 while assuming different frequency 

profiles for e(t) and w(t) . We note, however, that in Section 4,3.1 

it is shown that the types of signals that do give rise to infinite 

gain arise in practical situations. 
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4 . 3 Two Mechanisms of Instability 

In the* last section, it was shown that *11 the continuous- 
time adaptive control algorithm# studied in this thesis contain 
an infinite gain operator, in this section, we use the algorithm 
CM to introduce and delineate two mechanisms which may cause 
unstable behavior in the adaptive system CM when it is implemented 
in the presence of unroodeled dynamics and excited by sinusoidal 
reference inputs or by disturbances. The arguments made for CM 
are valid for algorithms CA2, c*3, and CM mutatia mutandis . 

Since the arguments of instability are heuristic in nature, they 
must be verified by simulation. This will be done in Section 4 . 4 . 

4.3.1 The Causes off Possible Instability 

In order to demonstrate the infinite gain nature of the feed- 
back operator of the error system of CM in Section 4.2.1, it was 
assumed that a component of w(t) had the form 

w. (t) « b ■+ c sinui t (4-5) 

X o 

and that the error had the form 

e{t) a a sink) t (4-6) 

The arguments of Section 4.3,2 indicate that) if a(t) and a 
component of w(t) have distinct sinusoids at a common frequency. 
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*, » .gi 

the operator of eqn. (4-1) and the operator of eqn. 

(4-18) will have infinite g^ins. Two possibilities for e(t) 
and w(t) to have the forms of eqn. (4-6) and eqn. (4-5) are now 
considered. 


Case (1) : If the reference input consists of a sinusoid 

and a constant, e.g. 


r(t) » r, + r„ sinw t 

o 


(4-24) 


where r_ , and r_ are constants, then the plant 
1 2 

output y(t) will contain a constant term and a 


sinusoid at frequency U) Q . Since 


w ( t) 


r (t) 

wjt) 


i-1 


and 

w . (t) « 

Ul P 

tu(t ) ) 1 

i**l 9 2 9 • . • , n-1 

(2-4) 


i-1 




and 

- P 

ty (t) J > 

f >2 f • • * $ i\ 

(2-5) 


all components of the vector w(t) will contain a 
constant and a sinusoid of frequency 
If the controlled plant matches the model at d.c. 
but not at the frequency 0 J Q) the output error 


e(t) * y (t) - y M (t) 


(2-13) 



-252- 

ORIGINAL PAGE IS 
OF POOR QUALITY 

will contain a sinusoid at frequency u) q . Thus, the 
conditions for infinite gain in the feedback path of 
Figure 4-1 have been attained. 

Case (2): If a sinusoidal disturbance, d(t), at frequency 0 ) 

o 

enters the plant output, as shown in Figure 4-5, 
the sinusoid will appear in w(t) through the fol- 
lowing equation which replaces eqn. (2-5) in the 
presence of an output disturbance 
i-1 

Wyi (t) - — [y (t)+d(t) ) ; 1=1,2, . . . ,n (4-25) 

The following equation replaces eqn. (2-1 3} when 
an output disturbance is present 

e(t) = y (t) + d(t) - y (t) (4-26) 

M 

Any sinusoid present in d(t) will also 
enter e(t) through eqn. (4-26). 

Thus the signals e(t) and w(t) will contain sinu- 
soids of the same frequency ind the operators H . 

w(t) 

and display an infinite gain. 

We note here that while the frequencies present in the reference 
input can be controlled by the designer of the adaptive system, there 
is no control over what disturbances are present. Sinusoidal dis- 
turbances, in fact, are extremely common from a number of sources. 



Figure 4-5. Controller structure of CA1 with additive 
output disturbance, d(t). 
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4.3.2 Instability Due to the Gainof the Operator G 


of liqua t ion ( 4-1 ) 


The operator of eqn. (4-1) is not only an infinite gain 
operator but its gain influences the system in such a manner as 
to allow arguments using linear systems concepts, as outlined 
below. 

Assume, initially, that the error signal is of the form of 

eqn. (4-6), i.e., a sinusoid at frequency to . Assume also that 

o 

a component of w(t) is of the form of eqn. (4-5), i.e., a constant 

plus a sinusoid at the same frequency to Q as the input. The 

output of the infinite gain operator, of eqn. (4-1), as given 

by eqn. (4-9) consist of a sinusoid at frequency to Q with a gain which 

increases linearly with time plus other terms at 0 radians/sec 

(i.e. d.c.) and other harmonics of to i i.e. 

o 


1 2 

u(t) = -ac t s into t + 

£ O 


other terms. 


Then the infinite gain operator manifests its large gain by 

producing at the output a sinusoid at the same frequency, u) .as 

o > 

the input sinusoid but with an amplitude which increases linearly 
with t ime plus some other signals. By concentrating on the signal 
at frequency to^ and viewing the operator ^ as a simple time- 

increasing gain with no phase shift at the frequency to Q and very 
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small gain at other f requencies, we will be able to come up with 

\ 

a mechanism for instability of the error system of Figure 4-1, 
redrawn in Figure 4-6 which emphasizes the impact' of the operator 

G w(t) ■ 

Q A 

If the forward path, pF^r • of the error loop of Figure 4-6 

r 

has less than + 180° phase shift at the frequency ti)^, and if the 
gain of were indeed small at all other frequencies, then 

the high gain of at <*> o would not affect the stability of the 

error loop. 

If, however, the forward loop , r*TTF * does have 180° phase 

K A 

r 

shift at the combination of this phase shift with the sign 
reversal will produce a positive feedback loop around the operator 
G w(t) ' tliereb y reinforcing the sinusoid at the input of G w j t j* 

The sinusoid will then increase in amplitude linearly with time, as 

Q 

the gain of G ... grows, until the combined gain of G ,, . and . * 

wit; — - — w(t) k^A 

exceeds unity at the frequency U) q . At this point, the loop itself 

will become unstable and all signals will grow without bound very 

quickly (as the effects of the unstable loop and continually growing 

gain of G w ^ compound.) 


Since the infinite gain of G . can be achieved at any 

w (t ) 

q*B* 

frequency Ui , if has + 180° phase shift at any frequency 

O 1C A , " T * 
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the adaptive system is susceptible to instability from either a 

reference input or a disturbance as shown in Section 4.3.1. 

Thus the importance of the Relative Degree Assumption A3 of 

q*B* 

Section 2. 2. 1.2 which allows one to assume that frr is strictly 

K. A 

r 

positive real is seen. The stability proof of CAl hinges on the 
g*B* 

assumption that r*rr is strictly positive real and that G . . 

K A Wit/ 

r — 

is passive, i.e. 



[e (t) ] e (t)dt > 0 


(4-27) 


Both properties of positive realness and passivity are pro- 
perties which are independent of the gain of the operator involved. 
However, it is always the case that, due to the inevitable unmodeled 
dynamics, only a bound is known on the gain of the plant at high 
frequencies . Therefore, for a large class of unmodeled dynamics 

in the plant, including all unmodeled dynamics- with relative degree 

g*B* 

two or greater, the operator, » will have + 180° phase shift at 

1C A 

r 

some frequency and be susceptible to unstable behavior # if subjected 
to sinusoidal reference inputs and/or disturbances in that frequency 


range. 
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4.3.3 Instability Due to the Gain of the Operator H 
of Equation (4-18 ) — 

In the previous subsection, the situation was examined where 
the amplitude of the sinusoidal error e(t) grew with time due to 
a positive feedback mechanism in the error loop. In this subsection, 
wc explore the situation where the sinusoidal error, e(t), is not 
at a frequency where it will grow due to the error system but rather 
when there exist persistent steady-state errors. Such a persistent 
error could arise from either or both of the two mechanisiiB discussed 
in Section 4.3.1. 

1) A reference input with a number of frequencies is 
applied and the controlled plant with unmodeled 
dynamics cannot match the model in amplitude and 
phase for all reference input frequencies involved. 

This will cause a persistent sinusoid in both the 
error e(t), through eqn. (2-18), and the signals 
w(t), through eqns. (2-4) and (2-5) 

and/or ^ jun output sinusoidal disturbance, d(t), enters as 
shown in Figure 4-5, causing the persistent 
sinusoid directly on e(t), through eqn. (4-26), 
and w(t) through eqn. (4-25) . 
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Assume that, through one of the above or any other mechanism, 
a component of w(t) contains a sinusoid at frequency as 
in eqn. (4-5) and that e(t) contains a sinusoid of the same 
frequency. Then the operator has infinite gain and the norm 

of the output signal of this operator, fc(t), increases without 
bound. The signal, k (t) , will take the form of eqn. (4-8), 
repeated here: 

K(t) * ic + ^ ac t + — - cosO) t - sin2t0 t (4-8) 

o 2 w o 4<j) o 

o o o 

From the second term one can see that the parameters of 
the controller 

k(t) = k * + K(t) (2-14) 

will increase without bound. 

If there are any unmodeled dynamics at all, increasing the 
size of the nominal feedback controller's parameters without 
bound will cause the adaptive system to become unstable. Indeed, 
since it is the gains of the nominal feedback loop that are unbounded, 
the system will become unstable for a large class of plants 
including all those whose relative degree is three or more even 
if no unmodeled dynamics are present. 
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4.4 Simulations with Time-Varying Inputs 

4.4.1 Introduction 

In this section, the response of the various continuous -time 
adaptive algorithms is explored through the use of simulation. 

First, it is demonstrated that the heuristic argument of Section 

4.3.2 which explains the instability caused by sinusoidal inputs of a 

certain frequency is valid. This is followed with a short 

demonstration and discussion of the response of the algorithms to 

sinusoidal reference inputs which are of a frequency other than 
a*B* 

that at which rvpr of Figure 4-6 has + 180° phase shift. 


4.4.2 Simulations of Algorithms CAl, CA2 and CA3 with 
Sinusoidal Reference Inputs 

The simulations were generated using the usual plant with 
unmodeled dynamics 


y (t) 


2 

(s+1) 


229 

(s 2 +30s+229) 


Iu(t)] 


and the usual reference model 


(3-27) 


y M <t) c (3-20) 

The simulations were all started out with the initial 
conditions 

k r C0) = 1.14 


k (0) = -0.65 
y 


(4-28) 
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For all three of these algorithms the nominal controlled plant 
is the same, given by eqn. (2-22) and for the parameters of eqn. 
(4-28) equals 


g*B* 


527 

s 3 +31s 2 +259s+527 


(4-29) 


The reference input signal was chosen based upon the discussion of 
Section 4.3.2: 


r(t) = o.3 + 1.85 sin 16.lt (4-30) 

The frequency 16.1 rad/sec is the frequency at which 

plant and, for all three algorithms CAl, CA2, and CA3, the trans- 
g*B* 

fer function ^ as 180° phase lag. A small d.c. offset 


r 

was provided so that the linearized system would be asymptotically 
stable (see Section 3.3.5). The relatively large amplitude, 1.85, 
of the sinusoid in eqn. (4-11) was fth^sen so that the unstable 
behavior would occur over a reasonable simulation time. A smaller 
sinusoidal amplitude could be used with the effect that the in- 
stability would occur at a much later time. 

Note that the reference input (4-30) is not large from the 
point of view of the stability of the linearized system as discussed 
in Section 3.3.5 (where it was shown that a constant reference input 
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of r*4.2 was necessary to cause instability for CAl). The 
linearization for algorithms CA2 and CA3 was stable for all 
size inputs. 

Adaptation gains of y=1.0 were used for CAl and CA2 and an 
adaptation gain of y=3.0 was used in CA3 to offset the total gain 
reduction caused by the normalization of the adaptation gain in 
that algorithm. 

Figures 4-7, 4-8, and 4-9 show respectively the simulation 
results for CAl, CA2, and CA3. The plant output and the para- 
meters k r (t) and k y (t) are plotted. All three algorithms show the 
instability phenomena predicted in Section 4.3.2. 

The amplitude of the plant output at the critical frequency 
(oj o = 16.1 rad/sec) and the parameters grow linearly with time, 
until the. loop gain of the error system becomes larger than unity. 

At this point in time, even though the parameters are well within 
the region of stability for the linearized system, highly unstable 
behavior results. 

Figure 4-10 shows the results of a simulation of the algorithm 
CAl with 

r (t)=0. 3 + 2.0 sin 8.0t (4-31) 

This simulation demonstrates that^if the sinusoidal input is 
at a frequency for which the nominal controlled plant does not 
generate a large phase shift-(at u q =Q.O, the phase shift of eqn. 

(4-29) is -133°), the algorithm may stabilize despite the high gain 
operator. Similar results were achieved with simulations of algo- 


rithms CA2 and CA3. 






Figure 4- 8. Simulation of CA2 with unmodeled dynamics and 

r(t)=0.3 + 1.85sin16. It 
(System eventually becomes unstable.) 

I . . 

i ... 

3 

I 





(No instability observed) . 
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4.4.3 Simulation of the Algorithm CA4 with Sinusoidal 
Reference Inputs 


The algorithm CA4 requires. a slight modification of the 
analysis. Due to the addition of a zero, from the filtering of L 

* b* 

in this algorithm, (eqn. (2-63)), the phase of — for CA4 is 

k^-A 

always less than 180° degrees. The same filtering, however, pro- 


duces an added 90° phase lag in w^ and thus in the high gain 
operator. 

Figure 4-11 shows the simulation results of running CA4 with 


L = s+3 (4-32) 

and r (t) = 0.3 + 1.85 sin 16.lt (4-33) 

q*B* 

At this frequency (W Q = 16. l), has 90° phase shift while 

r 

another 90° is generated by the high gain operator through the 
multiplication by w^ which has been shifted 90° from y by the 
filtering of 7 - . Thus, the overall error loop has 180° phase 
shift, and the system becomes unstable just like the other 
algorithms for the reference .input (4-33). An adaptation gain of 
Y=10 was used in the simulation to offset the attenuation of the 
additional filtering inherent in the CA4 algorithm. 

An interesting effect occurs when we simulated CA4 with the 
reference input 


r (t) = 0.3 + 2.0 sin 8.0t 


(4-34) 
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The total phase shift of the error system at this frequency 

(<o =8.0) is less than 180° but stilL greater than 90°. Figure 
o 

4-12 shows that the output appears to be converging. 

However, the parameter continues to drift as a correlation 
still exists between w and €. When the simulation was allowed 

y 

to run longer than shown in Figure 4-12, the parameter (t) 
continued to drift away until it moved to the point where the 
linearized error system was no longer stable. At this point the 
system broke wildly and suddenly into instability, because of the 
mechanism of Section 4.3.3. 

Finally, Figure 4-13 shows the simulation of CA4 with 


r (t)=0. 3 +2.0 sin 1.5t (4-35) 

At this frequency the filtering ^ provides only -26° phase shift 

L 

g*B* 

and provides only -40° phase shift. The system converges 

r 

nicely. 


4.4.4. Conclusions 

The simulations of this section verify that the mechanisms for 
instability which were hypothesized by our houristic arguments do 
indeed occur. The following statements about the continuous- time 
algorithms CA1-CA4, operating in the presence of unmodeled dynamics 
with sinusoidal reference inputs can be made: 







Tfur 



TIME 


Figure 4-13. Simulation of CA4 with unmodeled dynamics and 

r(t)=0. 3 + 2. Osinl. 5t 
(No instability occurs.) 
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• When faced with certain frequency sinusoidal ref- 
erence inputs in the presence of unraodeled dynamics 
the algorithms CA1-CA4 will produce an error 
function which is a growing sinusoid and will 
become unstable via the mechanism described in 
Section 4.3.2. 

• Instability via the mechanism of Section 4.3.2 

requires a high frequency reference input, i.e., 

it is highly likely to occur when the frequency 

of the reference inputs is at a frequency where 

cf^B^ 

the nominal controlled plant, ( of eqn. 

r 

(2-22) for CA1-CA3 and of eqn. (2-63) for CA4) 

has + 180° phase shift. Instability can still 

occur when the sinusoidal reference input is at 

g*B* 

a frequency where has more than + 90° 

phase shift, as the feedback operator, G v ^) of 

eqn. (4-1), can provide up to + 90° phase shift. 

This effect occurred in the simulation of 

Figure 4-11. When the frequency of the reference 

g*B* 

input is at a frequency where ■ 2 — j— has less than 

A 

+ 90° phase shift, stability is not guaranteed but 
instability wil) not occur by the mechanism of 


Section 4.3.2. 
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• If the reference input is such that the controlled 

* 

plant cannot match the model for all frequencies 
present in the reference input, instability can 
occur by the mechanism of an unbounded parameter 
gain, as described in Section 4.3.3. Instability 
of this type is shown in the simulation of 
Figure 4-12. 

Finally, we note that the results of this section merely 
verify that some situations for possible instability which were 
argued heuristically in the previous section to be part of continuous- 
time algorithms do indeed occur. However, there is no proof that 
instability will occur in these situations nor is there any 
guarantee that instability will not occur in situation where the 
heuristic arguments do not indicate instability. 



- 274 - 


ORIGINAL PAGE IS 


4.5 The Use of Filters on the Output 

4.5.1 Introduction 

Since the infinite gain behavior of the adaptive control 
system is most disruptive at high frequencies, it appears possible 
that better behavior can be attained by using low pass filters 
either on the plant output or the error signal. It has been 
argued by several researchers that such filtering will allow the 
adaptation mechanism to ignore high frequency components and, 
therefore, not be fooled by them. We disagree with such conjec- 
tures: Rather, we argue that what constitutes a high frequency 

signal is determined by the amount of pease shift present in the 
system; "tricks" such as the introduction of low pass filters 
merely add to that phase shift and, thereby, lower the frequency of 
the reference signal which will cause the adaptive system to become, 
unstable. 

4.5.2 Filters on the Plant Output 

The effect of filters used directly on the plant output as 
shown, for example, in Figure 4-14 of CAl is easily explained. The 
filter is simply considered as part of the plant. The designer 
either ignores the filter in the adaptive design, a strategy which 
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Model 



Figure 4-14. Controller structure for CA1 with 
filter on plant output. 
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reduces the filter itself to the realm of unmodeled dynamics, or 
he increases the order of the adaptive system and adapts around the 
filter as well as the plant. This latter strategy takes the 
system back to the beginning as far as unmo4eled dynamics in the 
plant-filter combination are concerned. 

Thus, adding a filter to the output of the plant does 
nothing to change the basic stability problem discussed in Section 
4.3.2. 


4.5.3 Filters on the Output Error 

Filtering the output error is slightly different in that the 

filtering no longer appears in the primary control loop around the 

plant, but it only appears in the adaptation mechanism as shown in 

Figure 4-15. A possible analysis is as follows. 

F 

Assume some kind of filter, — , were used on the error signal 

G 

of the CAl algorithm. Then the error system of Figure 2-2 becomes 

the error system of Figure 4-15. Instead of the debilitating 

sinusoid explained in Section 4.1 being at the frequency where 

the phase of zmr is + 180°* it is nOw simply where the phase of 
R K — 

r 

rrvr- is + 180° degrees. If f- is a low pass filter, then the 
k AG - G 

r 

destabilizing input will be at a lower frequency. 


Error system of CA1 with filtering on output error . 
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Thus, we see that filtering the output error, like filtering 
the plant output itself, does nothing to change the basic stability 
problem outlined in Section 4.3.2. 


4.6 Simulations of Responses to Disturbances 

4.6.1 Introduction 

It was mentioned in Section 4.3.1 that the sinusoid that 
drives the error system to instability could arise either from the 
reference input or from an output disturbance. In this section, 
it is shown that the instability mechanism explained in Section 

4.3.2 does indeed occur when there is an output, disturbance at the 
wrong frequency, entering the system as in Figure 4-5. In addition, 
the instability mechanism of Section 4.3.3, which will drive the 
algorithms unstable when there is a sinusoidal disturbance at any 
frequency , is also shown- to actually take place. 

The simulations of this section were generated with the usual 
plant with unmodeled dynamics. 


y (t) = 


2 

(s+1) 


229 

~2 

s +30s+229 


Iu(t)l 


(3-27) 


and the usual reference model 

3 


y M <t) = 


s+3 


[r(t)J 


(3-20) 
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The simulations were all started out with: 


k y (0) * -0.65 k r (0)=1.14 


For these parameters the nominal controlled plant of eqr. . 
(2-22) is: 


# - 


527 


s 3 +31s 2 +259s+527 


(4-29) 


4.6.2 Instability via the Mechanism of Section 4.3.2 

Figure 4-16 shows the simulation results when algorithm CAl 
is driven by 

r = 0.3 (4-36) 

with a disturbance 

d(t)= 5.59xl0~ 6 sinl6.lt (4-37) 

q*B* 

At the frequency, u) o =16.1, of eqn. (4-29) has 180* 

phase shift. The by now expected growing instability occurs 

due to the mechanism of Section 4.3.2. The only surprise may be 

the minuteness of the disturbance (~10 ) which will cause instability . 

The same unstable response was obtained with ail the other algorithms 


considered. 
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4.6.3 Instability via the Mechanism of Section 4.3.3 

* - * T T " 

Figure 4-17 shows the results of & simulation of CAl that was 
generated with 

r=0. 3 (4-36) 

but the disturbance was changed to 

d(t) = 8.Qxl(f 6 S in5t (4-38) 

g*B* 

At U) o =5 , ^* A 7f of eqn. (4-29) provides only -102° phase shift so 

*r 

the sinusoidal error signal of increasing amplitude, which is 
characteristic of instability via the mechanism of Section 4.3.2, 
is not seen in Figure 4-17. What is seen is that the system becomes 
unstable by the mechanism of Section 4.3.3) while the output appears 
to settle down to a steady state sinusoidal error, the parameter 
drifts away until the point where the controller becomes unstable. 
(Only the onset of unstable behavior is shown in Figure 4-17 in order 
to maintain scale.) We note also that^even when the error appeared 
settled its value represented a large disturbance amplification rather 
than rejection. 

The most disconcerting part of this analysis is that none of 
the systems analyzed have been able to counter this parameter drift 
for a sinusoidal disturbance at any frequency tried ! 

Indeed, Figure 4-18 shows the results of a simulation run 
*?ith reference input 


r = 0.0 


(4-39) 


Figure 4-17. Simulation of CA1 with unmodeled dynamics 

r(t)=0.3, and d(t)=8. 0x1(f 6 sin5.0t. 

(System eventually becomes unstable.) 





Figure 4-18. 


Simulation of CA1 with unmodeled dynamics'/ ’ 
r(t)=0.0, and d(t)=3.0x10 . 


(System eventually becomes unstable.) 
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and constant disturbance 

d « 3.0xl0“ 6 (4-40) 

The simulation results show that the output again settles 
for a long time, again with disturbance amplification, but the 

* 

parameter increases xn magnitude until instability ensues. 

Thus the adaptive algorithm shows no ability to act even as a 
regulator when there are output disturbances. 

4.6.4 Egardt's Modifications 

The only one of the continuous- time algorithms in which dis- 
turbances are even mentioned during the development of the algorithm 
for the properly modeled case is CA4. 

Egardt ( 11] gives a possible modification of CA4 in the 
presence of disturbances. The modifications considered consist 
of two fairly unsatisfactory alternatives. One of Egardt's 
modification assumes that there is an upper bound for the sire of 
the disturbance at any time (an assumption that cannot be guaranteed 
in practice! Egardt suggests that all parameter adaptation be stopped 
when the error is less than this Upper bound. The second of Egardt's 

*Tlio analysis of Xaonnou I 661 shows that, if there were no disturbance 
in this case, the output would converge to zero. Iaonnou's thesis 
contains no analysis in the presence of disturbances. 
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modif ications introduces a term into the parameter adjustment law 
which will arbitrarily decrease the magnitude of the parameter 
when the magnitude of the parameters gets too large. In this way, 
Egardt achieves bounded parameters and can then prove stability in 
the face of disturbances when there are no unmodeled dynamics. 

It is not clear that either of the proposed modifications 
would work if unmodeled dynamics are present. 

Even in the properly modeled case, these modification are 
designed to produce some kind of boundedness result with no as- 
surance that the adaptive algorithm will produce a result with 
anywhere near the original intent. 

4.6.5 Conclusions 

In this section it has been shown that the adaptive control 
algorithms CAl-CA4 > when operated in the presence of unmodeled 
dynamics and output disturbances at any frequency ^display the traits 
of disturbance amplification and instability . 

Unless something is done about this adverse reaction to dis- 
turbances in the presence of unmodeled dynamics, the adaptive 
algorithms examined cannot be considered as serious practical 
alternatives to other methods of control. 



4.7 conclusions 
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in this chapter it was shown by analytical methods, and 
verified by simulation results, that the adaptive algorithms 
CA1-CA4 have imbedded in their adaptation mechanisms infinite 
gain operators which, in the presence of unmodeled dynamics, will 
cause : 

• instability, if the reference input is a high 
frequency sinusoid. 

• disturbance amplification and instability t if 
there is a sinusoidal output disturbance at any 
frequency including d.c. 

While the first problem can be alleviated by proper limitations 
on the class of permissible reference inputs, the designer has no 
control over the additive output disturbances which impact his system. 
Sinusoidal disturbances are extremely common in practice and can 
produce disastrous instabilities in the adaptive algorithms considered. 
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CHAPTER 5 

ANALYSIS OF DISCRETE-TIME ALGORITHMS 

In this chapter the discrete-time algorithms introduced in 
Section 2.3 will be analyzed. The constant input analysis that 
was performed for continuous-time algorithms in Chapter 3 will be 

performed for discrete-time algorithms in Section 5.1. In Section 

1 

5.2, it will be shown that the discrete-time algorithms also become 
unstable for certain types of sinusoidal inputs and disturbances. 
This exactly parallels the development for continuous-time 
algorithms that was presented in Chapter 4. 

The following results are presented in this chapter: 

• In the presence of unmodeled dynamics and constant 
reference inputs all the discrete-time algorithms 
considered will become unstable if the design 
parameters are not carefully chosen. The analysis 
of Section 5.1 provides a design tool for choosing 
the parameters properly. 

•In the presence of unmodeled dynamics, high fre- 
quency reference inputs will cause all the adaptive 
systems studied to become unstable. 

• A sinusoidal output disturbance at any frequency 
will cause the feedback parameters in all the 
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algoritfruns studied to increase without bound. 

This will cause the adaptive system to become 
unstable if any unmodeled dynamics are present. 

In addition to the above results which parallel the results 
obtained for continuous- time systems, in Chapter 3 and 4, it is 
shown in this chapter that instabilities due to constant or sinu- 
soidal reference inputs in the presence of unmodeled dynamics 
can be eliminated, if the system is sampled slowly enough. 

A slow sampling rate, however, does not help the stability 
properties in the presence of an output disturbance. 
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5.1 Analysis of Discrete -Time Algorithms with Constant 
Reference Inputs 

5.1.1 Introduction 

The development in this section parallels the development given 
in Chapter 3 for continuous-time algorithms. The same assumptions 
will be made, i.e., that the system is close to some nominal sot 
of parameters, that the reference input and the nominal signals 
in the system are constant, and the t the system is free from noise 
and disturbances. The system will be linearized around the nominal 
parameters and signals and the behavior of this linearized error 
system will be examined. 

5.1.2 Analysis of DA2 

The analysis of DA2 (see Section 2.3.3) is undertaken first 
since this is the simplest of the discrete-time algorithms and 
provides the clearest view of the issues involved. 

The equations of DA2 (see Table 2-8) are analyzed by linearizing 
the system about a nominal set of parameters as was done for the 
continuous-time algorithms in, e.g.. Section 3.3.6. Assume that 
w it) from eqns, (2-94)- (2-96) is represented as follows: 

w(t) = w*(t) + 6 w (t) (5-1) 

and that the parameters, k(t) , are represented as follows: 


k(t) = k* + S k(t) 


(5-2) 
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Linearizing the system about w* (t) , k* reduces the error 
system of Figure 2-16 to the linearized error system of Figure 
5-1. If, in addition, the reference input, r, is assumed constant, 
then the signal w* can be taken as a constant and the linearized 
error system of Figure 5-1 becomes linear and time- invariant. 

In Figure 5-1 


-d 


g* B*q 

k*A* 


A(l-q“ 1 K 


k*g q 
r p 


)- 


u 


V 


-a 


P BK 


(2-103) 


The local dynamics of the error system are determined by first 
establishing a nominal system and then performing a d*-root locus 
on the error system of Figure 5-1. Note that the DA2 algorithm has 
a normalizing factor in the adaptive gain. The definition 


d* = 


*T * 
w w 

, 4 *T * 
1+w w 


is used so that 0<d <1. 


(5-3) 


The error system can then be represented as in Figure 5-2 with 


V s ' 1 ’ 


g*B»g P 

(l-q" d )kV 


(5-4) 



-291- 


ORIGINAL PAGE S3 
OF POOR QUALITY 



Figure 5-1. Linearized error system for DA2. 
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Using eqns. (5-4) and (2-103) it can be seen from Figure 5-2 
that the roots of the linearized ^error , ay stem will be given by 
the solutions of the equation 


(i-q" d ) (a(i-<i‘\) -g p q p Mt y )n a*9 p q *-» 


(5-5) 


5.1. 2.1 Analysis of System with Wo Unmodeled Dynamics 

Consider first the case whan the system is mode led properly 
As was mentioned in Section 2. 3. 3. 2 t it is possible to achieve 


with 


■ q’ d 

A' 


L* « ~ 

r g. 


(2-104) 


(5-6) 


Substituting eqns. (2-104) and (5-6) into eqn. (5-4) yields { 


g e ” 




-d 


(5-7) 


1-q 


The d*-root loci for the error system of Figure 5-2 with G 


E 

as in eqn. (5-7) are given in Figure 5- 3a for d«l and in Figure 5-3b 
for d»3. In both cases , it can be seen that the linearized system is 
stable if 

0 < yd*g < 2 
1» 


(5-8) 


YTUAv'f 
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Figure 5-2. Reduced linearized error system for DA2. 
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* 

Figure 5**3. d -root loci for DA2 with no unmodeied dynamics. 


'*t5rr *."«*“* 


* ;••■»:* *™ « ***«*• vtrtKars. r:.;;;; - 
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Indeed, this is exactly the condition for global stability 
given in t 10 ] . Thus , for the DA2 algorithm with no unmodeled 
dynamics, the local stability analysis performed in this section 
gives the same condition as the global stability proof performed in 
I i°l. 

If one could choose y so that 

Yd*g = 1 (5-9) 

P 

the error system itself would be deadbeat, i.e., the error would 
become zero after d^ steps where d^ is the properly modeled pure 
plant delay. 

From eqn. (5-2) , one can see that d* is close to unity for a 
large range of reference inputs. Therefore, if the plant gain g^ 
is known, eqn. (5-9) can be satisfied for a large range of reference 
inputs by choosing 


Y = 


(5-10) 


Indeed the choice of y given by eqn. (5-10) is implied as the 
proper way to choose the adaptation gain for DA2 in ( 10 ] . Although 
this choice of gain produces a very fast and well behaved error 
system when no unmodeled dynamics are present, we will see in 
Section 5. 1.2.2. 3 that the gain of eqn. (5-10) will be far too large in 

the presence of unmodeled dynamics. Large gains in the presence of 
unmodeled dynamics will produce unstable adaptive systems. 
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5.1.2. 2. A Numerical Example of a System with Unmodeled Dynamics 

When there are unmocleled dynamics present in the plant, the analysis 
follows along very similar lines as in Section 3.3.4. The key issues 
will be examined by example. 

Although this section provides analysis for only a specific 
example, conclusions can be drawn from this example which are 
true more generally. 

Any type of unmodeled dynamics can be studied using the 
techniques of this section. In particular, an important consideration 
in discrete-time systems are errors in the determination of the delay. 
Errors in time delay specifications can be handled just like any other 
unmodeled dynamics. In this case, the unroodeled dynamics consist of 
poles at the origin but no zeroes. 

The example used in this section will consist of the first order 
plant with second order unmodeled dynamics that has been used 
throughout this thesis. 


y (t) - 



229 

s 3 +30s+229 


) 


u (t ) 


(3-27) 


In order to obtain a discrete-time system which is equivalent 
to the system (3-27), the standard technique of discrete-time control 
system analysis called hold equivalence was used (see [ 68 ] , Section 
3.4). The continuous-time plant of eqn. (3-27) is preceded by a 
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zero-order hold and followed by an impulse sampler which is 
synchronized with the zero-order hold. The resulting discrete- 
time systems is equivalent to the original continuous-time system 
in that both sys tens will produce the same output at the sampling 
instanfcs^if the input to each system is constant from one sam- 
pling instant to the next. 

• Although anti-aliasing filters (see [ 68 ] ) are usually 
included in discrete- time controller designs, such filters are 
not specifically treated here. Any filter, such as an anti-aliasing 
filter, operating upon the plant output can be considered as part 
of the plant. Indeed, since the presence of an anti-aliasing 
filter is often ignored when designing the adaptation mechanism, it 
is reasonable to consider an anti-aliasing filter as part of the 
unmodeled dynamics of the plant. 

For our initial investigation a sampling period of T=0.04 
seconds was used. This represents fairly fast sampling, since 
it is approximately ten tiroes as fast as the fastest dynamics in 
the plant.* 

The discrete-time description of the plant Ls: 


y (t) - 


(0.00361) (1+0. ^g" 1 ) (l+2.763q~ 1 )q~ 1 

(1-0. 961q _1 ) (l-(0.547+j0,044)q~^) (1- (0. 547-jO. 044)q‘ 1 ) 



(5-11) 


The importance of the sampling interval in determining the 
stability of the adapt ive control system in the presence of 
unmodeled dynamics is discussed in Section 5.1.2. 3. 
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The model was chosen as the discrete-time equivalent of eqn. (3-20) . 

y ( t) . [t(t)] (5-12) 

M l-(.88)q 1 

Note the presence off the non-minimum phase zero at -2.763 
in the discrete-time version off the plant as predicted in [69 ]. 

The validity off the linearized analysis is unaffected by this 
non-minimum phase zero. 

5. 1.2. 2.1 Stability Analysis 

Figure 5-4 shows a k*-root locus which determines the poles off 
the nominal controlled plant of eqn. (2-103) for the plant of 
eqn. (5-11). 

A set off gains which will produce a stable nominal controlled 
system is given by: 

k* = -0.8? k* *= 1.32 (5-13) 

y r 

g*B* 

The position of the poles of - ■ with the parameters of 

eqn. (5-13) is indicated by boxes (□) in Figure 5-4. 

The y d*-root locus of the error system poles given by eqn. 

(5-4 ) , using the parameters of eqn. (5-13 ) , is shown in Figure 5-5. From 
Figure 5-5 it can be seen that the linearized error system is unstable for 

yd* > .35 (5-17) 
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Figure 5-6 shows the results of a simulation generated with 
the parameters initialized at the values given in eqn. (5-13) 
and with 

y-0.2; r*0.1; yd**0.04 (5-14) 

The system is well-behaved. 

Figure 5-7 shows the results of the same simulation but with 

Y=0 t 2, r*10.0 yd*=.199 (5-15) 

As ejected from the yd*-root locus of Figure 5-5^ the system is 
oscillatory. 

If yd is too large, then there exists no nominal system for 
which the error system is stable. This is shown in Figure 5-8 
which gives the k*-root locus of the linearized error system of 
Figure 5-2 with 

yd* = .94 (5-16) 

The root locus analysis of Figure 5-8 replaces the Routh- 
Hurwitz analysis of Section 3, 3.5.3 in establishing for which 
values of yd* there does not exist a set of parameters which lead to 
a stable linearized system. This root-locus type of analysis is 
not as exact as the Routh-Hurwitz analysis, since it only establishes 
whether or not there exists a stable linearization for particular 


PARAMETERS OUTPUT 
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Figure 5-6. Simulation of DA2 with unmodeled dynamics, 

r=D.1, andy-0.2. 
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Figure 5-7. Simulation of DA2 with unmodeled dynamics, 

r=10.0, andy=0. 2 
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values of yd . It is, however, much simpler to perform in the 
case of discrete time systems and still provides the designer 
with a good idea of how large his adaptation gain can be in order 
to maintain stability. 

For this numerical example, the analysis shows that, if yd* 
is close to 0.94, instability problems will ensue, while if 
the value of yd* is smaller that of eqn. (5-16), the yd*-root 
locus of Figure 5-8 will pass through the unit disk indicating 
that a set of parameters for which the linearized system is 
stable exists. 

Thus, if we let y=l and r is increased , yd* will approach 
0.94 and the system will go unstab Le. 

Figure 5-9 shows the simulation result with 

7=1.0, r=l. 5 (5-17) 

The value r=l. 5 corresponds, through eqn. (5-3), to d*=.81. In 
this case, there are sets of parameters for which the linearized 
system is stable. The parameters of the simulation converge to 
such a set of parameters. 

Figure 5-10 shows the results of a simulation with r increased 
to 


r=3. 1 


(5-18) 
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Figure 5-10. Simulation of DA2 with unmodeled dynamics, 

r«1. 62, and yst.O 

(System eventually becomes unstable.) 
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This value of the reference input corresponds, through eqn. (5-3), 
to d*«=. 95. Now there is no set of parameter values for which 
the error system is stable and the plant output blows up. 

The stability behavior of discrete-time systems which has 
boon discussed so far has been very similar to the behavior of the 
continuous-time systems. If the gain of the adaptation mechanism 
is made too largo the system becomes oscillatory and unstable. 

This is the same conclusion that was reached for CA3 in Section 3.4 
and for CA4 in Section 3.5 as these algorithms both have the 
normalizing factor creating an error system gain similar to that of 
eqn. (5-3). 


5. 1.2. 2. 2 Model Matching in the Presence of Unmodeled Dynamics 
In order to study the ability of the DA2 algorithm to match 
the reference model in the presence of unmodeled dynamics, we return 
to study the nominal controlled system of eqn. (2-103) when the 
nominal parameter values of eqn. (5-13) are in effect along with 
the plant of eqn. (5-11) and the model of eqn. (5-12). 

The nominal controlled system with the parameters of eqn. (5-13) 

y*B*c£_ d ^ (.0046)q~ 1 (l-t0.196q" 1 ) (1+2. 763g“ *) 

A (l-.82q" 1 ) (l-.79q _1 ) (l-^Sq’ 1 ) 
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allows the nominal closed-loop controller of Figure 2-15, 


y(t) 


(.0046) (.12)q~ 1 (H-Q.196q" 1 ) (l^^Gag" 1 ) fr(t)J 
(l«.88q“*) (l-.82q“ 1 ) (l-^Oq' 1 ) (l-^Sq" 1 ) 


to match the model's d.c. gain but does not provide an overall 
reasonable match of the model. In fact, no values for the para- 
meters, k* and k*, will allow model matching. Due to the dead- 
pan* 

beat structure of the DA2 algorithms all the poles of must 

be moved near the origin to provide Cor good model matching. This 
cannot occur for this example as Figure 5-4 shows. Even approximate 
model matching will not occur for the algorithm DA2 in the 
presence of a large class of unmodeled dynamics. * 


In Section 5. 1.3. 3 we will see that a modification of DA2 
present in DA3 allows approximate model matching in the pre- 
sente of unmodeled dynamics. 
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5. 1.2. 2. 3 The Effects of Design Parameters Chosen Without 
Consideration of Unmodeled Dynamics 

In this section, we investigate what the effects would be on 
a system with unmodeled dynamics if the design parameters of the 
adaptive controller were chosen as if there were no unmodeled 
dynamics. We find that, due to the structure of the DA2 system 
(which prefilters the reference input through the model's dynamics 
and follows with a deadbeat controller), the feedback and adaptation 
gains suggested by an analysis which ignores unmodeled dynamics 
are excessively large. 

Thus the lesson that the designer of an adaptive controller 
must take into account unmodeled dynamics in- his design is 
stressed. The analysis that takes place here is only for DA2 where 
the effects of ignoring unmodeled dynamics in the design process 
is especially evident but the lesson should be heeded no matter 
what algorithm is used. 

if there were no unmodeled dynamics and the plant followed 
the equation 

y ( t> = r U ( t )l (5-i9) 

1-. 961q""^ L J 

the desired values of parameters for the algorithm DA2 necessary 
to match the model could be attained from eqn, (2-104) > and (2-103) as: 
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k* = -12.32 k* * 12,82 

y r 

an 1 the suggested adaptive gain from eqn. (5-10) would be: 
y * 12.82 

If the parameters of the linear system were chosen as in 
eqn. (5-20 ) , the nominal controlled plant would be unstable 
with poles at 

z = . 88+j.52; z = . 88-j.52; z=.25 

Thus, an analysis of the DA2 system which were performed 
without taking unmodeled dynamics into account would lead a 
designer to pick a nominal parameter set which would produce an 
unstable controller in the presence of even very high frequency 
unmodeled dynamics. 

In addition, we have seen from Figure 5-8 that the error 
system of this example will be unstable for a large range of 

i 

constant reference inputs if the adaptation gain is chosen to be 
larger than 0.94. We stress that the gain of eqn. (5-21) sug- 
gested by an analysis ignoring unmodeled dynamics is more than an 
order of magnitude larger than the gain which would produce a stable 
system for all values of constant reference input . 


(5-20) 


(5-21) 


(5-22) 
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Thus we see that it is critical that a designer have some 
idea of what unmodelled dynamics may be present in a plant and choose 
the design parameters so that the adaptive system behaves well in 
the presence of unmodeled dynamics. After all, this is always done 
in classical non-adaptive designs! 


5. 1.2. 3 The Effects of the Sampling Interval 

There is an additional design parameter in discrete-time 
systems not present in continuous- time systems which can increase 
tolerance to unmodeled dynamics. That parameter is the sampling 
interval. 

Let the system of eqn. (3-27) be sampled at a rate of T=.4, 
instead of T=.04. Such a sampling rate is fairly slow in that it 
represents five times the speed of the modeled pole; however, 
sampling of the unmodeled dynamics occurs at barely once per cycle. 
The equivalent discrete time system is now given by 


y (t) = 


(0.629) (l+.0399q~ 1 ) (H-.0048q~ 1 )q~ 1 

(l-.Gltl 1 ) (l-(. 0017+ j. 0018) q" 1 ) (1- (.0017- j .0018) q _1 ) 


Iu(t)l 


(5-23) 

We note there is no longer a non-minimum phase zero, as was 
the case in eqn. (5-11) where the plant was sampled faster. Indeed, 
the poles and zeroes of the unmodeled dynamics are very close to 
each other so that their effects almost cancel. 
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Figure 5-11 shows the k*-root locus of the nominal controlled 

y V * . 

• < 

plant of eqn. (2-103) when the open loop plant' is described by 
eqn. (5-23) . From Figure 5-11, we notice that all the nominal control 
system poles can be placed close to the origin and that the nominal 
closed- loop controller of Figure 2-15 can be made to match the model 
fairly closely. 

The Yd*-root locus of Figure 5-12 then shows that the unraodeled 
dynamics hardly come into play allowing the full Yd*=2 of eqn. (5-8) 
gain with retention of stability. 

Figure 5-13 shows the results of a simulation made with the 
system sampled at T=.4 and 

Y = -i— = 1.58; r=10.0 (5-24) 

g p 

The parameters were started at what would be their desired values 
if no unmodeled dynamics were present 

k* = -1.06; k* = 1.58 

y r 

The system behaves as if there were no unmodeled dynamics at 
all. The plant and the model output in Figure 5-13 coincide. 

Figure 5-14 shows the same type of simulation but with the 
parameters started out at zero. The system adjusts quickly to 
follow the model again as if no unmodeled dynamics were present. 
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cal example of Section 5.1.2. 3. 
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Figure 5-13. Simulation of DA2 with umnodeled dynamics 
slow sampling ,k y (0)=-1.06 # *nd k^(0)-1.5$* 
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Thu# we have teen that, if a di soft fee- time adaptive system 
with high frequency unmedeled dynamics ia designed for constant 
input# and with a alow enough sampling interval, the ay a taw can be 
made to behave almost aa if thara were no unmodeled dynamics at all. 
Although thia is shown only for a numerical example using DAS, the 
conclusion arises trow the fact that, in the slowly sampled system, 
the poles and aetoes of the unmodeled dynamics almost cancel and 
thus the result will he true for more general plants with high fre- 
quency unmodeled dynamics and for dll discrete-time adaptive control 
aigoritlfifta. 

h.1.3 The Anal ysis o f DA3 

As was mentioned in Section 2.3.4, the algoritl\m da 3 is very 

similar to DA2. Its stability properties a* analysed in Section 

% 

5. 1.3. 2 are fundamentally the same as those of 1>A2 in that, if 
the adaptation gain is chosen small enough, the linearised error 
system will he stable for all constant reference inputs for a large 
^J&ss of unmodeled dynamics. However, too large an adaptation gain 
will lead to an unstable error system for a large class of constant 
-reference Inputs and unmodeled dynamics. 

There is, however, one important addition in DA3 not present 
in UA2, the added filter h of Figure 2-17. We will see in Section 
h. 1.3.2 that, w-M;h this filter as part of the nominal controlled 
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plant, • ■ - vt* of Figure 2 - 1 . 7 , ,, the reference model can 

* . . * * 

still be fairly closely matched in the pretence of high frequency 
unmodeled dynamics, unlike the DA2 algorithm. 

In Section 5 . 1 . 3 . 3 , it is pointed out that, with a proper 
choice of L, the model can be mate md in the structure of DA3 
with no feedback at all. This observation makes clear a weakness 
of the problem formulation of all the model reference adaptive 

V 

control algorithms. The only objective of these algorithms is 
to have the controlled plant match a reference model. This should 
be but one objective of a control system. 

Finally, we note here that slowing the sampling rate will cause 
the effects of high frequency unmode led dynamics upon the adaptive 
system DA3 to be greatly reduced as was the case with DA2. 


5. 1.3.1 Analysis 

The tool for analysis once more consists of linearizing around 
a nominal set of parameters and assuming that the input is constant. 

Following this approach, the error system of Figure 2-16 is 
reduced to that of Figure 5-15 where 


-d 

aXJLg *, 

k*A* 

r 


-d 

g q P PLB 

— =r— 

(J?-q K )A-g q JP BK 
* u p y 


( 2 - 110 ) 
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Fiqure 5-15. Linearized error system for DA3. 

♦ ^ ■ 5; . * v. - • ■**.»> t. 
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T 

w, w 

d * = -d 


A +W,W, 
o -d-d 


(5-25) 


If the delay, d , is unity, the system further reduces to that 


of Figure 5-16 where 
-d 

a*, 

G, 


s!sl 


B* 


kVd-q' 1 ) 


(5-26) 


5. 1.3. 2 A Numerical Example with Unmodeled Dynamics 

In this section, we apply the algorithm DA3 to the example of 
Section 5. 1.2. 2 with the fast sampling rate T=.04 secs. 

The plant with unmodeled dynamics is described by eqn. (5-1.1) 
and the model by eqn. (5-12). Since the system is designed as a 
first order system, the filter P of eqn. (2-108) is not used. 

Choose 

-1 * 
L « An = l-.88q (5-26) 

It is assumed that there is no disturbance so n , the 

c 

degree of C in eqn. (2-106), is set to zero and through eqn. 

(2-109) w r and, hence, k r are scalars. 


Thu choice of L is discussed in Section 5. 1.3. 3. 
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The system is linearized about the parameters. 

. * * * ? 

f u t ■ * * 


k* a -0.615 k* a 1.16 

y r 

leading to a nominal controlled plant which is calculated from 
eqn. (2-118). 


(5-27) 


9*q~ X B* 


( . 035) q" 1 (1-fO. 196q -1 ) (1+2. 763q" 1 ) 
(l-.71q"’ 1 ) d-^q” 1 ) 


(5-28) 


The pole at 2=.88 is cancelled by the zero due to L at 
za.88. Thus the nominal closed loop controller of Figure 2-17 
for the parameter of eqn. (5-27) matches the reference model over 
the frequency range of zero rad/sec. to about 8.5 rad/sec where 
the pole of eqn. (5-28) at z=. 71 takes effect.* 

The d*-root locus for the error system of Figure 5-16 linearized 
about the parameters of eqn. (5-27) with G_ from eqn. (5-26) and 

It 

(5-28) , 

m (.035)q~ 1 (l-f0. t 196q~^~) d^^SSq" 1 ) 

E (l-^lq" 1 ) (l-^eq" 1 ) (1-q" 1 ) 

is shown in Figure 5-17. With a gain of 

yd* <6.9 


* 

This is much better than the model matching ability of DA2 shown 
in Section 5. 2. 2. 2 which does not have the additional filtering 
L to cancel the low frequency pole. 
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Figure 5-17. yd -root locus for numerical example of Section 5.1.3. 2. 

(Zero at z=- 2. 76 not shown.) 
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the linearized error system of Figure 5-16- w/i.11 be stable*. 

Figure 5-18 shows the results of a' simulation started with 

the parameters at their nominal values given by eqn. (5-27) and 

with 


Y = 3.0; r = 10.0; yd* = 2.98 (5-29) 

The system behaves well as the linearized analysis predicts 
it would. 

Figure 5-19 shows the results of a simulation with 

Y = 13.98; r = 10.0; yd* = 13.91 (5-30) 

There is a set of parameters which produces a stable error 
system for y<3* as in eqn. (5-30). However, the system parameters 
must move to values which produce a stable linearized error for 
such a large adaptation gain as in eqn. (5-30). In Figure 5-19, 
the parameters move to 

k* = -7.5 k* = 67 (5-31) 

7 r 

The nominal closed loop controller of Figure 2-17 for the 
parameters of eqn. (5-31) is 

(.03) (.12) (l+.196q~^) (1+2. 763q”‘ L ) 

y(t) = IT (5-32) 

(l-.88q ){l-.3q ) (1- (. 86+j . 41)q ) (1- (.86-j.41)q ) 

_ — 

The system of DA2 would not have a stable linearization for this 
example if yd* > .94 (Fig. 5-16). Thus the added filter, L, in 
DA3 has made DA3 able to remain stable at higher adaptation gains 
then DA2. 
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Figure 5-18. Simulation of DA3 with '.modeled dynamics and y=3.0. 
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This does not come close to matching the model of eqn. (5-12) . 
Thus, as is the case with all the algorithms, if the adaptive gain 
is too large, the adaptive controller of DA3 may not be able to 
match the model even if it can maintain stability in the presence 
of unmodeled dynamics. 

Although there is a stable linearization for yd* as in eqn. 

(5-30), this value for yd* represents as large a value of yd* for 
which there is a stable linearization. When the parameters are 
increased t'M 

y = 13.981; r = 10.0; yd* « 13.912 (5-33) 

there is no longer a value of k*, which will produce a stable 
linearized system. The simulation of Figure 5-20, with the para- 
meter values set as in eqn. (5-33) , becomes unstable as predicted. 

Thus, in this subsection, it has been shown that the algorithm DA3 
reacts essentially the same as the other algorithms with some 
advantage over DA2 due to the added filtering of L. It is clear 
that a slower sampling rate would help DA3 in exactly the same 


way it helped DA2 
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5. 1.3. 3 The Need to Desi>m the Nominal Controller Well 
— r — - - - - - — 

in this section we show that if the filter, L, is chosen 
properly in DA3, the nominal control system can be made to match 
the reference model with no feedback at all. Such an open loop 
control design is clearly not desirable. This points out the 
need for the adaptive system designer to consider the design 
of the nominal control system carefully in the context of the 
model reference problem formulation where the only criterion of 
performance involves the systems response to reference input. It 
is left to the designer to try to construct the system so that, 
if it converges as desired, the resulting nominal control system 
will perform all the functions usually expected of a control system 
such as disturbance rejection and sensor noise reduction. 

In the sequel, we assume that the plant contains no unmodeled 
dynamics and is given by 


y<t) = 


, 078q 


< 1 


l-.961q 

with the reference model of eqn. 


-1 


V*’ ■ 




-i 


1- . 88q 


-1 


- [u(t) ] 
(5-1) 

[r (t) ] 


(5-19) 


(5-11) 


In Chapter 4 and Section 5.2 it is seen that at this point, the 
design process is a losing battle since, even if the nominal 
controller has good disturbance rejection properties, the adaptive 
system is extremely sensitive to disturbances. 
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L = A ■ l-^lq” 1 (5-34) 

then the nominal closed-loop controller of Figure 2-7 is 

.078k*(l-.961q _1 ) 

y (t) = f j Ir(t)] (5-35) 

(l-.88q ) (l-.961q -.078k*q ) 

Thus the nominal controller will match the reference model 

with k*=0, i.e., with no feedback. While such a controller 
Y 

would provide the desired response for reference inputs, it would 
provide no disturbance rejection at all. Even if the adaptive con- 
troller converged as desired, the resulting controller could 
hardly be considered adequate. 

This discussion of a possible solution with DA3 points out the 
more general danger of the present adaptive control problem formula- 
tion which states as its only objective the open loop property of 
model following. The designer must supply the additional 
reasoning necessary to obtain closed-loop objectives such as dis- 
turbance rejection, and noise reduction while retaining robustness. 

5.1.4 The Analysis of DAI 

The algorithm DAI does not simplify when the delay is unity as 
the algorithm DA2 does. This makes its analysis slightly more in- 
volved although conceptually the same as the other algorithms. 
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% 

£,1,4,1 Analysis ^ 

Assume that the parameters and signals of the system remain 
neap nominal vainer and that the input ie constant, Using the 
game arguments aa in Section 3. 2 fop CA2, the continuous- tine 
counterpart to RA1, the error system for RAl given in Figure 2-12 
reduces to that of Figure 5-21, where now 


-1 


Q ® 


i-q 


‘i 


-d 

q*n*g P 

uwiawik'W'W^u sw, vm, 

K*A* 


H%V 

‘W MBWa BW tl W uiW U j p wi 


-d 


h * 9 nV 


♦ p 


IWJ.litWBJ.WHJft 

>% 


and 


d* a w T w, P a yi 


(5-36) 

(5-37) 


hue t© the last term in eqn. (5-37) the system Q g will have 
as many aeroea aa poles * 

Xf P is chosen large enough, the system will he stable for 
ail values of d*. However, choosing p too large will cause 6, 
to he small whether the closed loop system matches the model or 


not, since will be dominated by the p term* Physically, 
what happens is that, when P is too large, the loop containing P 
in the controller structure of Figure 2-13 dominates the loop that 
contains the nominal controlled plant. Hence, the error becomes 
insensitive to changes in the controller parameters and adaptation 
proceeds very slowly, 

<Si\a linearised error system of PM is fairly complicated and 
will be analysed in the context of specific examples. 
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5. 1.4. 2 A Numerical Example with No Unmodeled Dynamics 

The same example that has been used throughout will be used 
again. First, assume that the system is modeled correctly. The 
plant is 

y(t) e £u(t)] 

l-.961q _1 

and the model is 

y (t) = ^)£ 1 . [r(t)] 

l-MBjq " 1 


Cancel the first two terms of eqn. (5-36) by choosing the 
desired nominal system to be 


-d 


q*B*q 

A* 


g B q 
y M M h 


-d 



(5 


(l 


Equation (5-38) is achieved with the following numerical values. 


k* » -1.02 k = -- =1,54 
y r g 

P 

Since the system is designed as a first order system, the 
filter P in eqn. (2-70) vanishes. Choose the auxiliary filter 


of eqn. (2-75) as 


M ~d 
— cj — 
L H 


-1 


1- . 88q 


-1 


>—19) 

>- 11 ) 

>-38) 

>-39) 

1-40) 


(5-41) 
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Then the equation for G 


g q 

G = 

£ 


-1 


i-q 


-l 


for this examples is: 
+ Pg M 



(5-42) 


and the system will be stable for aJl d* if 


P > 



(5-43) 


This is indeed the condition given for stability of the 

algorithm in [ 7 } (where it is assumed that g = g ) . Thus, 

p M 

for the algorithm DAI the local linearized analysis gives the 
same stability condition on p as the global stability proof. 

The analysis above suggests a rule of thumb for choosing p. 
The value 


P = 


g M 


(5-44) 


should provide the fastest error system without allowing oscillation 
when d* gets large, as the zero in eqn. (5-42) will be located at the 
origin and the pole of the d*-root locus will be trapped near the 
origin for large values of d*. 
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5. 1.4. 3 A Numerical Example with Unmodeled Dynamics 

Use the same plant with unmodelftd dynamics as in Section 
5.2.2. 


• » / A* * 

> I wy “ 


(0.00361? (l-t-O.lQSq" 1 ) (1+2. 763q“ 1 )q~ 1 

(l-0.961q""’ L ) (1- (0. 547+j . 044)q‘ 1 ) (1- (0. 547- j . 044)q~ 1 ) 


[U(t>] 


(5-10) 


The model and the auxiliary filter will be chosen as in 
the properly modeled case. 

Choose the nominal parameters to be 


k* « -0.6151 k* - 1. 16; h* » 
y r k" 

r 


.86 


(5-45) 


q*B* 

leaving with poles at 


z * 0.88? z » 0.71 and 2 = 0.46 


(5-46) 


and unity do gain, approximately matching the model. 

In order to find a value of p so that the error system is 
stable for all values of d*, eqn. (5-36) is broken up as follows 


G 


E 



P*0 


+ V 


(5-47) 


The discrete- time Nyquist plot of G E |p„Q for the nominal system 
given by eqn. (5-45) is given in Figure 5-22. The term pg„ merely 
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Figure 5-22. Discrete-time Nyquist plot for C^j 
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shifts this plot to the right. The error system will be stable 
for all values of d* if 

p > — « 22.5 ( 5 - 48 ) 

9 M 

This is much larger than the value of p which would be 

picked if unmodeled dynamics were ignored. With no unmodeled 

dynamics, eqn. (5-44) using g from eqn. (5-12) and g u from 

p n 

eqn. (5-11) would give a suggested value for p, 

p = 0.65 (5-49) 

In this example, we will see that for p as in eqn. (5-48) 
the adaptive system DAI behaves well. However, when p is lowered 
to values somewhat below that of eqn. (5-49) , the adaptive system 
will become oscillatory and then, as p is further reduced, unstable. 

Figure 5-23 shows the results of a simulation with the para- 
meters initialized according to eqn. (5-44) and with 

p » 23.0; r = 10.0; d* = 200.0 (5-50) 

The system behaves well for this value of p as predicted in the 
preceeding analysis. If p is chosen smaller than the value given 
by eqn. (5-48) , the error system may remain stable but the para- 
meters will move to a more stable configuration and model matching 
will be compromised. Figure 5-24 demonstrates this with a simulation 
generated with 


p = 0.319 


(5-51) 
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The parameters move to 

k* = -1.2} 
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k* 
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- 1.7; h* = 0.03 


(5-52) 


The oscillations in Figure 5-24 are harbingers of impending doom. 
As Figure 5-25 shows , when p is lowered to 


p = 0.31828 


(5-53) 


and all other values remain t. the same t the system is unstable. 


Again , it is noted that if the system were sampled at a slow 
rate the unmodeled poles and zeroes would almost cancel and this 
system would behave in a manner close to the properly modeled case 
as explained in Section 5. 1.2. 3. 


5.1.5 Conclusions 

In this section, it has been shown that the linearization with 
constant input method, developed in this thesis, is an extremely 
useful technique for analyzing the behayior of discrete- time 
adaptive control system as well as for continuous- time adaptive 
control systems. 

Using this technique, it was shown 

• If adaptive controllers are designed without 
regard for unmodeled dynamics, unstable systems 


are likely to result 
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• Using the linearization analysis of Section 5.2, 
adaptive systems can be designed which behave well 
locally when presented with constant reference 
inputs and no disturbances in the presence of certain 
classes of unmodeled dynamics. 

• In Section 5. 2. 2. 4, it was shown that much of the 
problem of high frequency unmodeled dynamics is 
alleviated, if the discrete-time system is created 
with a slow enough sampling rate. 

5 . 2 Analysis of Discrete-Time Algorj thms with 

Sinusoidal Inputs and Disturbances 

5.2.1 Introduction 

This section provides for discrete-time systems the analog of the 
analysis in Chapter 4 for continuous -time systems . 

Subsection 5.2.2 shows that an infinite gain feedback operator is 
present in all the discrete-time systems investigated and Subsection 
5.2.3 shows that this infinite gain operator can result in unstable 
behc vior in response to certain sinusoidal inputs and all persistent 
s inusoidal disturbance s . 

Subsection 5.2.4 contains the simulations which show that the 
adaptive algorithms will indeed become unstable in the presence of 
unmodeled dynamics for certain sinusoidal reference inputs. 

Subsection 5.2.5 deals with the response of the systems to 
sinusoidal disturbances. It is shown there that such disturbances 
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lead to parameter drift and instability. Finally, Subsection 
'>.2.p ile.il.fi with a phenomenon unj<|uo to < I » imo Myntem, In 
it, the choice of the sampling interval and its effect on the 
ability of the system to deal with sinusoidal inputs and distur- 
bances is examined. 

5.2.2 The Infinite Gain Operators 

5. 2. 2.1 Q uantitative Proof of Infinite Gain for the 
Operator of DAI 

In the discrete-time adaptive control systems studied there 
are infinite gain operators present in the error loop which exactly 
parallel the infinite gain operators in continuous-time adaptive 
system which were discussed in Section 4.2. 

The infinite gain operators of DAI are isolated from the error 
system of Figure 2-12 in Figure 5-26a. The signals w(t) and v(t) 
are assumed to be scalars. The infinite gain operators of DA2 and 
DA3 are identical. These are isolated from the systems of Figures 2-16 
and 2-18 and are represented in Figure 5-26b. 

In this subsection we will prove that two operators which will 
be defined from Figure 5- 26a are indeed of infinite gain. The 
proof for the operators of Figure 5- 26b is analogous and is omitted. 
The proof of infinite gain, if w(t) is a vector, follows from the proof 
for scalar w(t) since the operator infinite gain can arise from any 
component of the vector w(t) . 
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Figure 5-26a. Infinite gain operator for DAI 



Figure 5-26b. Infinite gain operator for DA2 and DA3. 
Figure 5-26 Infinite gain operators for discrete-time algorithms. 
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The operators of interest arc defined from Figure 5- 26s 
as follows: 


G w(t) ♦ v<fe) 


re(t)j 


t 

u o + wtt) l yv(T-l)e(T-i) 

T*1 


t 

H v(t )* e(fc)1 * + ? Yv(t-i)e(T-l) 


( 5 - 54 ) 


(5-55) 


The following operator theoretic concepts are introduced. For 
further development of these concepts see t 66 3 . 

Defini tion 5-1 > A function f(fc) from 2 + , the imv-negetive integers, 
to R is said to be in $> 2 if the following sum exists: 



(5-56) 


The quantity ) | ♦ | j * is celled the norm of the function. 


Do fi nit. ion 5-2: A function f(t) from 2 to R is said to be in 


jL^ if the truncated norm 


I l«<c> I U 4 ( I 

\ t»o f 


1/2 


(5-57) 


2 \t«0 

is finite for all finite T. 



o 
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Definition 5-3 1 The gain of an operator G(t(t)} which takes 
functions in K x into function* in 1L is defined as 

2c 2ft 


SUP 

| |g| l * f(t)e& 

Tea* 


IlGiettnll* 

*2 


2t ||*tt>]|* 


(S-3U) 




If there ia no unite number satisfying eqn. (5-Stt) » then G 
is «aid to have infinite gain. 

Theorem 5-1? If wtt) in given by 


w(t) « b t q sinto t 
o 


(3-59) 


and v(t) is given toy 


v(t) a to ■¥ e sinta (t+i) 
o 


(S-OQ) 


for any positive constants b,o, the operator G w ( t ) tV ( t ) 
of eqn. (5-34) has Infinite gain. 


Proof i The proof consists of finding a signal, €(t) , such that 


UWvtt> te(t)l|l l 


lim 


| G(t) | 


T 


is unbounded. 
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Throuohout the proof, all k^' e will represent finite positive 
constants, all d^’s will represent finite constants, while ail 
• s will be constant phase angles, 


Let 


€(t) » a siritt (t+l) (5-61) 

with a an Arbitrary positive constant, and the same 
constant as in oqns. (5-59) and (5-60). These signals produce* 


v(t-l)€(t-l) «|ac + d 11 sin(w o t+4' 11 ) < t d 12 sin(at*> o t+4 12 ) (5-62) 

A b 

k(t) - U v(fc) (6(t)) * k o + l yv(t-1H (t-1) 

T »1 

» k Q + y( I* ac t + d 21 ain(w o tt^ 2l )+ d 22 sin<2u> o t+<|> 22 ) ) (5-63) 

A 1 

utt) - « w(t)rV(t) t€(t)) »u Q + w(t) l yv(t-l)e(T-i) 

* u Q + | Y abc b + ~ yac 2 t sina^t 

+ d 31 * d 32 ain ^0*^32) * d 33 sin t 2 % t H 33 ) 

+ a S4 «*»<*V*V + d 35 ,in(2 V + *35' 


+ d 36 


(5-64) 
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,, *•> » 


Using standard norm inequalities we obtain 


I l u ^> 1 1 1 > I I \ yabct + | yac 2 t sinu) Q t| | J 


- (sum of the norms of the remaining terms of 
eqn. (5-64)) 


>|| “-yabct + j yac 2 t sinW Q t| | J - (1^) 1/2 - (K 2 T) 1/2 

2 


Now 


I yabct + j yac 2 t sint^t) 


r 1 2222 122 32. 

= I jycbt +iy a be t sinO) t 


t=0 


1 2 2 4 2 

+ — y a c t sin2W t 
4 o 


_ r /l 2 2 2 2 1 2 2 4\ 

\U< Yabo + * Yao ) 


2 1 2 2 3 2, 

t + — y a be t sino) t 
« o 


~ y 2 c 2 c 4 t 2 cos2co t 
Y o 


1/1 2 2, 22 1 2 2 4 \ 3 

3-\4 Y abc' + J Y *c j* - 


K 3 T - K 4 T - K 5 


Also 


| | € (t) J | = a l sin2w (t-l)£ a T 

*2 t=l ° 


Specifically 


ll*-B|| > IMI-I Ml 

ana ll»B|| > ||a|M|b|| 


(5-65) 


(5-66) 


(5-67) 
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Therefore, using eqns. (5-65), (5-66) and (5-67) 


^2 

l|e«t)|i; 

*2 


and hence, G . . ... for w(t) as in feqn. (5-59) and v(t) as in 

V It) ,W ItJ 

eqn. (5-60) has infinite gain 


(( 


2 2 2 2 
Y a be 

12 


^r) T 3 -V 2 - ( V K 4 )T - (K 1 +K 5’) 1/2 


aT 


1/2 


Theorem 5.2 ; The operator with w(t) given in eqn, (5-59) 

and v(t) given in eqn, (5-60) has infinite gain. 


Proof: Choose 6(t) as in eqn. (5-61). Then 


k(t) = H v(t) le(t) ] is given by eqn. (5-63) 


k(t) = k + ^ yact + d_.y sin (to t+(j> ) + d y sin(to t+<t> ) (5-63) 

O 2 21 O 21 22 O 22 


where, as in the proof of Theorem 5-1, all d„'s are finite constants 

and all d>. . are constant phase angles 0< <1>, . < 2 tt, and all K.'s 
13 — 13 “ 1 

will be finite positive constants. Using norm inequalities, we 


2 


|ic(t) | 




v 1 2 2 2 2 

l T Y a c t - K,T 


(5-69) 


t=0 


2 2 2 3 _ 

Vac T -_ _ K T 2 _ K T 

12 V V 


- K, 


(5-70) 


00 


obtain 
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Using eqn. (5-70) and eqn. (5-67) which states: 


I l e <t) I |T i* 2 t, 


(5-67) 


we obtain 


l|Mt>ll* 2 > (l 


2 2 2 

W~ t-k 2 t-k 3 t-k 4 


l 1/2 


■p+oo 




aT 


„V2 


. Ok) 


and, hence, H m has infinite gain for v(t) as in eqn. (5-60) . 

V iu) 


Q.E.D. 


5. 2. 2. 2 Qualitative Explanation of the Infinite Gain of 

G and H 
w,v v 

The qualitative explanation of the mechanism which results in 
the infinite gain of the operators and H v (t) is a 

discrete-time analogue to the discussion of Section 4.2.2. 

If v(t) and e(t) contain sinusoids of the same frequency and 
if these sinusoids do not have a phase difference of exactly 90°, 
the multiplication of v(t) and e(t) will produce a constant cor- 
relation term. The signal v(t)e(t) then enters an accumulator; 
the accumulation of the constant correlation term produces the 
infinite gain. Since the output of an accumulator with constant 
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input is a ramp, the output signal of the accumulator (which is 
also the output of increases in amplitude indefinitely with 

time. The output of G w ( t ) , v (t) is forreed b V multiplying the output 
of the accumulator by w(t) , producing a sinusoid with increasing 
amplitude at the frequency assumed present in w(t) . 

The explanation of infinite gain given in this subsection can 
be applied to explain the infinite gain of the operators which may 
be defined analogously to eqns. ($-54) and (5-55) from Figure $-26b. 


5.2.3 Two Mechanisms of Instability 

Two mechanisms of instability for discrete-time algorithms are 
now examined. These mechanisms are parallels to the mechanism 
discussed in Section 4.3 for continuous-time algorithms. 

These mechanisms depend on the infinite gain nature of the 
operators v ( fc j and as discussed in Section 5.2.2. 

In ordor to demonstrate infinite gain of these operators, it was 
assumed that e(t) and a component of w(t) and v(t) have distinct 
sinusoids at a common frequency as in eqns. (5-59), (5-60) and (5-61). 

The discussion of Section 4.3.1 shows that the equivalent 
signals of e(t), w(t), \r(t) in the continuous- time system will have 
a distinct sinusoid at a common frequency if either: 

1) The reference input has a distinct sinusoid, or 

2) There is a sinusoidal disturbance. 
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The points of the discussion of Section 4.3.1 hold also for 
the discrete-time systems and the discussion yd 11 not be repeated 
here. 


5.2. 3.1 Instability Due to the Gain of the Operator G of 
Equation (5-54 ) 

The first instability mechanism for discrete-time algorithms 
is the same mechanism which was discussed in Section 4.3.2. The 
mechanism will be explained here using the error system of DA2 
shown in Figure 2-16. The error system is redrawn in Figure 5-27 
which emphasizes the role of the infinite gain operator 


t 

G w(t) te(t>1 = ^ (t) T ? Q 


w^TjetT) 


lWjCCjw^Tj 


(5-72) 


Assume w(t) consists of a sinusoid of frequency to and a 
constant. The signal w, (t) is simply a delayed version of w(t). 

— XI — 

Assume that e(t) is a sinusoid of frequency Then, just as in 

the continuous time case, the operator G will manifest its 
infinite gain by producing at the output a sinusoid at the same 
frequency, U) q , as the sinusoidal error signal, but with an amplitude 
which increases linearly with time, plus some other signals. By 
concentrating on the signal at frequency and viewing the operator 
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Figure 5-27. Error system for DA2 emphasizing role of C w - 
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* ' i * 


# i i * 


G w (t) as a time increasing gain at the frequency U) q and very 

small gain at other frequencies, a mechanism for instability in 

the error system of Figure 5-27 will be exposed. 

-d 

g*q ^ B* 

Assume the forward loop, • oi the error system of 

X 

Figure 5-27 has enough phase shift at the frequency so that, when 

added to whatever phase shift may occur in the operator at 

the frequency 0) , the phase shift of the entire loop at u) is 
o o 

+180°. The combination of this +180° phase shift with the sign 
reversal of the feedback law will produce positive feedback in the 
error system loop, thereby reinforcing the sinusoid at the input of 


w<t) 


The sinusoid will then increase in amplitude linearly with 


time, as the gain of G w ( t ) grows, until the combined gain of 

-d ~ " 

q*B*q P 

* 5^3 exceeds unity at the frequency b) . At this point the loop 

r 

itself will become unstable and all signals will grow without bound 
very quickly. 

Due to the presence of the inevitable unmodeled dynamics in 
the plant, the phase of the forward path of the error loop, 

* ~ d B* 

^ '~ v» ~ • ta ke on each value between -180° and +180° at some 

k r 


and 
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frequency. Since the infinite gain of G . can be achieved at 

wit) 

any frequency u) q , the adaptive system is susceptible to unstable 
behavior via the mechanism described ih this subsection, if subjected 
to sinusoidal reference inputs and/or disturbances in the frequency 
range where the error loop produced +190* phase shift. 


5. 2. 3. 2 Instability Due to the Gain of the Operator 

H of Equation (5-55) 
w 


In this subsection we examine a mechanism of instability due 
to a persistent, but not growing, sinusoid in the plant output and 
the error signals of discrete-time adaptive control system. Such 
persistent sinusoidal signals could arise from a sinusoidal reference 
input and/or from a sinusoidal disturbance as explained for continuous- 
time systems in Section 4.3.3. A signal of the same frequency will 
also be present in the signal w(t) due to the dependence of w(t) on the 
plant output as in, for example, eqn. (2-95). 

The correlation of e(t) and signals derived from w(t) within 
the operator will cause a constant signal at the input to the 

accumulator of U w ^j in eqn. (5-55). The infinite gain of will 

then be realized as the output of the accumulator will contain a ramp. 
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Since the output of the accumulator of eqn. (5-55) is the parameter 
errors, jUt)^ the parameters of the controller , 

k(t) = k * + k(t) (2-84) 

will increase without bound. 

If there are any unroodeled dynamics at all, increasing the 
size of the nominal feedback controller parameters without bound 
will cause the adaptive system to become unstable. Indeed, since 
it is the gains of the nominal feedback loop that are unbounded, 
the system will become unstable for a large class of plants, 
including all these whose relative degree is three or more, even 
if no unmodeled dynamics are present.. 


5.2.4 Analysis of Discrete-Time Adaptive Systems with 
Sinusoidal Reference Inputs 

That the mechanisms of Section 5.2.3 do indeed occur and produce 
unstable adaptive systems in the presence of unmodeled dynamics with 
certain sinusoidal reference inputs is verified by digital simulation 
in this subsection. 

All the simulations displayed in this and the next subsection 
were generated with the example that has been used throughout this 
thesis, complete with unmodeled dynamics and sampled at the relatively 
fast rate of T=.04. The plant is represented as 
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y(t) = 


(0.00361) (l+.igSq" 1 ) (1+2. 763g~ 1 )q~ 1 

(1- . 961q _1 ) (1- ( . 547+ j . 044)q" 1 (1- ( . 547- j . 044)q _1 


[u(t)J 


(5-11) 


The model is represented as 


Y M (t > 


(. 12) q 
1- . 88q^ 


-1 


Ir(t)J 


(5-12) 


All simulations were generated with reasonable adaptive gains 
set well within the region which produces stable linearized systems. 
All parameters were started with values which match the model closely 
in some sense. All other states were started at zero. The 
initial condition are not particularly important to the results 
obtained. 


5. 2. 4.1 Instability Due the Mechanism Described in 
Section 5. 2. 3.1 

Figure 5-28 shows the plant output and parameters of DA2 
with the discrete-time input 


r(t) = 1.0 + 4.5 sin 


13. 5t 
.04 


(5-73) 


Figure 5-29 shows the plant output and parameters of DA3 with 
the discrete- time input 

r(t) * 1.0 + 2.5 sin 


04 


(5-74) 
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Figure 5-30 shows the auxiliary error € and tho < arameters of 
DAI with the discrete-time input 

r (t) = 1.0 + 5.0 sin (5-75) 

13.5 

The frequency oj = — ~ is the frequency at which the discrete- 
time plant of eqn. (5-11) with unmodeled dynamics has 180° phase 
shift and at which the positive feedback system discussed in Sec- 
tion 5.2. 3.1 is likely to be produced in all the algorithms. 

All three algorithms, DAI to DA3, do exhibit instability in the 
manner predicted by the mechanism of Section 5. 2. 3.1. The simula- 
tions all show a sinusoidal error linearly increasing in magnitude 
until a dramatic instability occurs. Only the onset of such an 
instability is shown in order to maintain reasonable scale in the 
graphs. 

If a sinusoid is introduced at a frequency at which the error 
system of, for example, Figure 5-27, has little total phase shift, 
the system may remain stable due to phase considerations even with 
the infinite gain operator in effect. This is seen in Figure 5-31 and 
5-32. Figure 5-31 shows the output error and the parameters of 
DA3 with a discrete-time input of 


r(t) = 0.1 + 1.0 sin — 

.04 


(5-76) 
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Figure 5-32 shows the auxiliary error and the parameters of 
DAl with the same input of eqn. (5-76). 

Figures 5-31 and 5-32 show the algorithms converging nicely to 
a point where both the dc and low frequency characteristics of 
the model can be matched. 

Figure 5-33 shows the output error and the parameters of 
DA3 with the input 

r(t) = 0.1 + 1.0 sin (5-77) 

This demonstrates that the growing sinusoid effect can occur 
at frequencies other than the exact frequency for which the plant 
display 180° phase lag. The positive feedback may be caused by phase 
shift introduced by lags in the infinite gain system or by the 
shifting of the parameters themselves changing the characteristics 
of the controlled plant. Similar results were obtained for all 
the algorithms in both continuous and discrete-time as there may be 
phase shifts for the infinite gain operator, G, in every algorithm. 

5 . 2 . 4 . 2 Instability Due to the Mechanism Described in 
Section 5. 2. 3 . 2 

The simulation of DA2 with the input of eqn. (5-59) 

2t 

r(t) = 0.1 + 1.0 sin 

shows a different behavior than that of DA3 or DAl from Figures 


PAGE tS 
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Figure 5-32. Simulation of DAt with unmodeled dynamics and 

r(t)=0. 1 + I.Osin^-t 
(No instability occurs.) 




Figure 5-33* Simulation of DA3 with unmodeled dynamics and . 
| r(l)=0.1 + 1.0s(nj£^t. 

(System eventually becomes unstable*) 

r'i ' ■ 


j.’ 

Y 

u 

|4 
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5-31 and 5-32. Figure 5-34 shows the output error and the para- 
meters of this simulation. 

First of all the error does not grow since the positive feedback 
is not present. However, because of the deadbeat setup of DA2 
discussed in Section 5. 1.1, the system cannot match the model in 
the presence of unmodeled dynamics. This causes the error to 
converge to a steady state sinusoid. The adaptive system is then 
driven to instability by the mechanism described in Section 5. 2. 3. 2. 

The parameters drift away as seen in Figure 5-33. This slow drift 
will continue until the parameters move to the point where the 
linearized system is unstable and then the system will become unstable. 
This is exactly what happened when the simulation was allowed to 
continue. All the algorithms studied, both in continuous and discrete- 
time, showed a similar behavior when confronted with a set of input 
frequencies that could not be well matched. 

5. 2.4. 3 Conclusions 

The digital simulations of this section verify the analysis of 
Section 5.2.3 which showed that, in the presence of unmodeled dynamics, 
the discrete-time adaptive control algorithms DA1-DA3 can become 


unstable with sinusoidal reference inputs. 




Figure 5-34. Simulation of DA2 with unmodeled dynamics and 

r(t)=0.1 + l.Osin^t. 

(System eventually becomes unstable.) 
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In Section 5.2. 4.1 it was found that the instability mechanism 
of Section 5. 2. 3.1 does indeed occur if the reference input is a 
sinusoid within a certain range of frequencies. The frequencies 
required to cause instability are always in the high frequency 
range but the exact frequencies can only be determined by a detailed 
analysis of the phase properties of the error system involved. 

In Section 5. 2. 4. 2 it was found that instability arose via 
the mechanism of Section 5. 2. 3. 2 f when the reference input consisted 
of a set of sinusoids for which the controlled plant could not 
match the response of the reference model due to unmodeled dynamics 
in the plant. 


5.2.5 Response to Additive Output Sinusoidal Disturbances 

The discrete-time adaptive control algorithms have the same 
unstable behavior in the presence of additive output sinusoidal 
disturbances as their continuous-time counterparts. The instabilities 
caused by sinusoidal disturbances can come about by the two mechanisms 
described in Section 5.2.3. 
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5. 2.5.1 Instability Due the Mechanism Described in Section 5. 2. 3.1 


The first mechanism is that a sinusoidal disturbance at the 
wrong frequency, one at a frequency where the nominally controlled 
plant with unmodeled dynamics has 180* phase shift, can excite 
the positive high gain feedback loop described in Section 5. 2. 3.1, 

The mechanism is the same as in Section 5. 2. 4.1 where the sinusoid 
was due to a reference input. We note , however , that while a 
designer may be able to control what reference inputs are used in a 
system, he has no Control over what disturbances the system faces. 

The sinusoidal disturbance will grow in amplitude^ as the in- 
finite gain operator does^ until instability occurs. This phenomenon is 
displayed in Figures 5-35 to 5-37. All simulations in this subsection 
were generated under the conditions described at the beginning of 
Section 5.2.4, except that a constant reference input was used and 
a sinusoidal disturbance, d(t) , was added to the output. 

Figure 5-35 displays the output and parameters of DA2 under the 
stimulus 

13. 5t 


r =0.1} d(t>= 0.1 sin 


.04 


(5-78) 


Figure 5-36 displays the output and parameters of DA3 
under the stimulus 

13. St 


r = 0.1; d(t)= 0.015 sin 


.04 


(5-79) 
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Figure S-35. Simulation of DA2 with unmodeled dynamics. 


r=0. 1 , and d(t)=0. IsinJ— t. 
(System eventually becomes unstable. ) 





Figure 5-37. Simulation of DAI with unmodeied dynamics 
r=0*. 1, and d(t)=0. Olsin^p^ t. 

(System eventually becomes unstable. ) 
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Figure 5-37 displays the oijtput end parameter* of Phi undar 
the stimulus 

r = 0.1; d(t) « 0.01 pin — (5-80) 

.OS 

All three systems show the increasing amplitude sinusoid in 
the error and the steady parameter movement. All three became 
grossly unstable when the simulation was continued. 

In all three simulation there is no semblance of disturbance 
rejection . Indeed, all three simulations show immediate 
disturbance amplification from which point the amplification 
increases until instability occurs. 

The amplitude of the disturbance was chosen in the simulation 
so that the instability would occur within a reasonably short 
simulation time. Smaller amplitude sinusoids will also cause disturbance 
amplification and instability but the system will take a longer 
time to become grossly unstable. 

5.2.5. 2 Instability Due to the Mechanism of Section 5. 2. 3. 2 

The instability caused by the mechanism of Section 5.2.3.? is 
again more disconcerting than that caused by the mechanism of 
Section 5. 2.3.1, because the former can happen at any frequency. 

A sinusoidal disturbance at a frequency where the controlled plant 
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does not have too much phase shift will not have the positive 
feedback growing effect. The error will converge for a while. 

It will not, however, converge to zero since the disturbance does 
not enter into the model. A steady state error will correlate 
with the disturbance on the output, creating a constant driving 
term to the parameter adjustment mechanism. The parameters drift 
away creating an ever increasing gain in the nominal control system. 

In the presence of unmodeled dynamics, this will cause instability. 

Indeed, any persistent error, which produces a constant cor- 
relation with the plant output, will cause instability via the 
mechanism of Section 5. 2. 3. 2. 

Figure 5-38 displays the output and parameters of DA2 with 
the stimulus. 

r = 0.1; d(t) = 0.1 sin . (5-81) 

Figure 5-39 displays the output and parameters of DA3 with 
the stimulus 

r ■ 0.1; d(t) = 0.01 sin — . (5-82) 

Figure 5-40 shows the output and parameters of DAI with the 
stimulus 

r = 0.1; d(t)— 0.007 sin * (5-82) 


OUTPUT 
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Figure 5-39. Simulation of DA3 with unmodeled dynamics, 
r=0. 1, and d(t)=0. Olsin^g^ t. 

(System eventually becomes unstable.) 
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Figure 5-40. Simulation of DAI with unmodeled dynamics, 
r=0.1, and d(t)=0. 007sin^^jj t. 

(System eventually becomes unstable.) 
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All the figures show the characteristic parameter drift and 
seemingly controlled error. All simulations did indeed become 
unstable when allowed to continue. 

- All the simulations also show that right from the beginning 
the adaptive systems show disturbance amplification rather than 
disturbance rejection. 


5. 2.5. 3 The Effect of Sinusoidal Disturbance Upon the 
Self-Tuning Controller of DA3 

As was mentioned in Section 2.3.3 the algorithm DA3 has a form 
which is designed to handle some disturbances. This is a type of 
self-tuning controller and it was also tested with sinusoidal dis- 
turbance. The self- tuning controller was designed so that the system 
is designed to handle output disturbances of the type 

u -1 -2 
1+c q +c q 

d(t) = i =-= Iv(t)J (5-84) 

A(q" A ) ‘ 

where v(t) is white noise. It is not too surprising that such a 
system can not handle the highly correlated output sinusoid 
disturbance that it was tested with. When the plant output is 
corrupted with a sinusoid the correlation between Wj(t) and e(t) 
in the operator of Figure 5-26 will produce a constant driving term 
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to accumulate In the operator no matter how the system adjusts. 
When the disturbance is of the form of eqn. (5-84) the system 
can adjust to remove the correlation between w^(t) and e(t). 

Indeed, the self -tuning controller performed just like the 
other adaptive systems. Figure 5-41 shows the output and main 
parameters, k Q , k , when the simulation was generated with the 
stimulus 

r - .1; d(t)- .016 sin • (5-85) 

The output shows the characteristic growing sinusoid of the 
positive feedback high gain system and the parameters show the 
familiar, by now, drift. 

Figure 5-42 shows the output and main parameters under the 
stimulation 

r * 0.1; d(t)=* 0.1 sin ‘ (5-86) 

The response is again as expected with the output error at 
least holding its own but with the parameters drifting away. 

Both simulations became unstable when allowed to continue. 

Both simulation show that the systems amplify rather than 


reject disturbances 
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Figure 5-41. Simulation of the Self-Tuning Controller with unmodeied dynamics, 

r=0. 1 , and d(t)=0. 016sin^j| t. 

(System eventually becomes unstable.) 


Figure 5-42. Simulation of the Self-Tuning Controller with unmodeled dynamics 

r=0.1, and d (t) =0. isin^ppg t. 

(System eventuslly becomes unstable.) 
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Thus, even the self- tuning controller designed to handle some 
types of disturbances performs atrociously when faced with a sinusoidal 
disturbance. We reiterate the disturbance that caused instability 
is not one that the system is designed to handle. The performance 
shown, however, still constitutes a major obstacle for the practical 
implementation of such adaptive controllers. 

One is reminded of the paper of Dumont and Belanger, [70] 
who in describing a "successful" application of a self- tuning 
regulator, stated 

"The long-term operation of the self-tuning regulator 
can give rise to some problems. After several weeks 
of satisfactory operation, the self -tuning regulator 
can create system oscillations... Another phenomena, 

. . . , is a blow-up of the parameter estimates when 
working with a forgetting factor less them one."* 


5.2.6 Conclusions 

It has been shown in Section 5.2 that, through two mechanisms, if 
any of the discrete-time adaptive control systems studied is operated 
in the presence of unmodeled dynamics with a high frequency reference 
input and/or a sinusoidal disturbance at any frequency, the adaptive 
system will become unstable. 

The response to disturbances is especially disconcerting since 
the disturbance can occur at any frequency and still exhibit the 

i 

* 

In our terminology a forgetting factor less than one corresponds to 
an adaptation gain that does not become arbitrarily small with time. 
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behavior of disturbance amplification and instability seen in 

the simulation^ of Section 5.2. While a designer may be able to 

* 

select his reference inputs he has no control over the disturbances 
a system encounters and sinusoid^?, disturbances are very common. 

It' is clear that the problems exposed in this section must 
be successfully resolved for adaptive control systems to become 
generally useful control systems. 


5.3 The Effects of the Sampling Rate on Discrete-Time 

Adaptive Control Systems 

It was seen in Section 5.1.1 that if the sampling rate chosen 
for discrete-time adaptive control systems with constant reference 
input -, is slow enough, many of the problems associated with 
unmodeled dynamics in these systems are greatly alleviated. 

This phenomenon is easily understood by looking at the pole- 
zero locations of a system sampled at different rates. 

Figure 5-43 shows the pole-zero locations of the plant used as an 
example throughout this thesis sampled at two different rates. 

The sampling periods are T**.04 and T*. 4. 

From this Figure 5-43, one can see that if the system is 
sampled rapidly the unmodeled poles and zeroes separate so that 
the poles produce substantial phase lag at intermediate frequencies, 
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Figure 5-43a. The system (3-27) sampled at T=0.04 secs. 



Figure 5-43b. The system (3-27) sampled at T=0.4 secs. 

Figure 5-43. Pole-zero plots of the system (3-27) with different sampling intervals 
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while zeroes contribute a small amount of phase lead until 
higher frequencies. Indeed the zero at z— 2. 76 has very little 
effect on the system at any frequency. 

When the system is sampled slowly, however, the unmodeled 
poles and zeroes coincide to all intents and purposes. Thus, 
they have little effect at all and the system behaves as if there 
were no unmodeled dynamics. 

The previous two sections discussed the response of adaptive 
control systems to sinusoidal inputs and disturbances when the 
system is sampled at T*.04 sec. The response of the systems* when 
sampled more slowly at T».4 sec., is now studied. Only the 
responses of the algorithm DA3 are shown in this section. The 
other algorithms reacted similarly. 

Figure 5-44 shows the output error and the parameters of the 
system under the stimulus 

7 

r (t) - 1.0 + 1.0 sin (5-87) 

. 04 

7.85 

and no disturbance. The frequency ui Q ■ ^ was 

chosen as the frequency at which the plant provides 180* phase 

shift. 

In Fig. 5-44 the output error starts out with the, by now, 
expected growing sinusoid. Since the unmodeled dynamics have little 
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effect at this slow sampling rate the system can adjust parameters 
to match the plant at both d.c. and this high frequency at the , 
same time and no persistent error signal develops . The error 
goes to zero and the parameters converge. Again * it is seen that, if 
the system is sampled slowly enough, the effects of high frequency 
unmodeled dynamics are minimized. 

Next, the effects of a slow sampling rate on the response to 
sinusoidal disturbances was investigated still using the 
algorithm DA3. 

Figure 5-45 shows the response to 

r - O.ljd(t) * s 1.0 sin • (5.88) 

Figure 5-46 shows the response to 

r = 0.1; d(t) ^0.1 sin • (5-89) 

The system reacts qualitatively the same as it did when the 
sampling rate was much faster, with the characteristic parameter 
drift. 

The reason why slowing the sampling rate did not improve the 
reaction of the system to the sinusoidal disturbance is because the 
debilitating parameter driirt is not fundamentally a problem of 
unmodeled dynamics, tt is a problem of the correlation in the 
algorithm. Unmodeled dynamics Serve only to accentuatethis problem 


OUTPUT 
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by, first, creating extra phase lag at smaller frequencies, thus 
adding to the possibility of the positive feedback effect, and, 
second, by shrinking the space out cf which the parameters must 
drift to cause instability. 

Thus, it has been seen that the detrimental effects of un- 
modeled dynamics in a disturbance-free environment for discrete- 
time adaptive control algorithms can be essentially eliminated by 
sampling the system slowly enough. However, all the problems 
associated with sinusoidal disturbances remain. 

A rule of thumb for choosing a sampling rate may be to have 
the sampling frequency be the same as the lowest frequency of 
the unmodeled dynamics. However, such a slow sampling scheme is a 
luxury seldom, if ever, available. The problems of sampling systems 
too slowly are well known (see t 68 ) , Chapter 10). In order to 
provide smooth enough and fast enough tracking of inputs and 
reasonable disturbance rejection in the nominal system, discrete- 
time systems have to be sampled up to 20 times as fast as their 
bandwidths. Since one of the goals of adaptive control is to push 
the bandwidth of systems up to the limit dictated by the unmodeled 
dynamics, the slow sampling rates required to remove those unmodeled 
dynamics cannot be used. Some other way to deal with them is 
required. In addition, even if one has the luxury of a slow sampling 
rate, the problems of sinusoidal disturbances must still bo addressed. 


5.4 


Conclusions 
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The following conclusions are obtained from the analysis and 
digital simulation presented in this chapter: 

• All the discrete-time adaptive control systems 
studied will have their control parameters 
increase without bound > if they are operated 
under the influence of a persistent sinusoidal 
disturbance at any frequency. Such unbounded 
parameters will surely cause instability in the 
presence of unmodeled dynamics and are likely to 
cause instability even when no unmodeled dynamics 
are present. Also, all the algorithms studied 
display disturbance amplification rather than 
disturbance rejection. 

• All the algorithms studied will become unstable in 
the presence of unmodeled dynamics^, if a high frequency 
sinusoidal reference input is used. 

• All the algorithne may become unstable in the presence 
of unmodeled dynamics and constant reference inputs , 
if the design parameters of the system are not Chosen 
carefully. The analysis of Section 5. 1 provides a 


- 393 - 


design tool which aids in choosing the design 
parameters to alleviate the stability problems 
only for constant reference inputs. 

• The stability problems associated with constant 
or sinusoidal reference inputs can be greatly 
alleviated by choosing a slow enough sampling 
rate in creating the discrete-time system. The 
problems associated with disturbances are not 
helped by the slower sampling. 

Clearly, until the aforementioned problems are solved the ap- 
plications of the adaptive control algorithms studied roust be 
extremely limited. The problems associated with disturbances are 
extremely troublesome since the designer has no control over what 
disturbances enter the system. Thus, one of the fundamental advantages 
of feedback control, i.e., the ability to minimize the effects of 
external disturbances, becomes the major downfall in the adaptive 


control algorithms 
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CHAPTER 6 

CONCLUSIONS AND DIRECTIONS FOR FUTURE RESEARCH 
6.1 Conclusions 

This thesis contains an exhaustive analytical and numerical 
investigation of the stability and robustness properties of a wide 
class of adaptive control algorithms in the presence of unmodeled 
dynamics and output disturbances, tor both continuous-time and 
discrete-time systems. The class of algorithms considered, those 
which are commonly referred to as model reference adaptive control 
algorithms, self- tuning controllers, and deadbeat adaptive controllers* 
have all been designed using a "black box" model for the plant. 

For each of the algorithms the assumption is made that the plant 
is a "black box", about which nothing is known except for the relative 
degree and an upper bound for the order of the plant . In addition, 
the primary performance criterion Used for the design of the adaptive 
systems investigated in past work is related to good command following. 
Using the "black box" assumption discussed above, each of the algorithms 
have been proven to be globally asymptotically stable. 

However, the "black box" assumption does not reflect adequately 
the knowledge a control system designer usually has about the plant. 

On one hand, the assumption on the order and relative degree of the 
plant is too restrictive from an engineering point of view. Real 


plants always contain unmodeled high frequency dynamics and small 
de,.ays and, hence, no upper bound on the number of the plant poles 
and zeroes exists. Also, real plants are always subject to unmeasurable 
additive output disturbances, although these may be small. On the 
other hand, the "black box" assumption may discard a great deal of 
knowledge that is available about the plant, e.g., the approximate 
location of the dominant poles of the system vis-a-vis the nature and 
range of frequencies of unmodeled dynamics. 

A unified analytical approach lias been developed in this thesis, 
that can be employed to examine the stability and performance pro- 
perties of this class of existing adaptive control algorithms in the 
presence of unmodeled dynamics and output disturbances. In Sections 
4.2 and 5.2.2, it was discovered that all existing algorithms contain 
an infinite-gain operator in the dynamic system that defines command 
reference errors and parameter errors > it is argued in Section 4.2.4 
that such an infinite-gain operator appears to be generic to all 
adaptive algorithms # whether they perform explicit or implicit parameter 
identification. The following practical engineering consequences of 
the infinite-gain operator are disastrous: 

• Analytical results of Section 4.3.2 and Section 
5. 2. 3.1 and simulation studies of Section 4.4.2 
and Section 5.2.4 demonstrate that, in the 
presence of unmodeled dynamics, sinusoidal 


396 


reference inputs at specific frequencies cause 
sinusoidal components in the plant output to 
grow without bound and the adaptive system to 
become unstable . 

• Analytical results of Section 4.3.3 and Section 
5.2. 3. 2 and simulation results of Section 4.4.3 
and 5.2.5 demonstrate that a sinusoidal output 
disturbance at any frequency, including constant 
disturbances, will cause the loop-gain of the 
adaptive control system to increase without bound, 
thereby exciting the (unmodeled) plant dynamics 
and yielding an unstable adaptive control system . 

Hence, it is concluded that none of the adaptive control algo- 
rithms considered can be used with confidence in most practical 
co ntrol system designs, because instability will set in with a 
high probability . 

In addition, results were obtained for the behavior of adaptive 
systems implemented in the presence of unmodeled dynamics but with 
constant reference inputs and no disturbances * The main results 
are: 

* By choosing the design parameters of the adaptive 
system as indicated by the analysis technique of 
Chapter 3 and Section 5.1, the existing adaptive 
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control algorithms can be made to remain stable 
and to follow infrequent changes in constant 
reference inputs well in the presence of a 
certain class of unmodeled dynamics^ if_there 
are no external disturbances . 

• In Section 5. 1.2. 3 and Section 5.3 it is 
shown that the instabilities caused by si- 
nusoidal or constant reference inputs in 
the presence of unmod~led dynamics can be 
eliminated in systems which use discrete- 
time algorithms to control continuous-time 
plants by sampling the continuous- time 
process slowly enough. However, instabilities 
caused by output disturbances will still 
occur regardless of the sampling rate . 

Thus, although the analysis techniques developed in this thesis 
can aid in some aspects of the designs of adaptive controllers using 
existing algorithms, the adaptive control system will still be 
vulnerable to instability attributable to the presence of the ine- 
vitable output disturbances and unmodeled dynamics. 
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6.2 Directions for Future Research 

It is clear from the preceding conclusions that the 11 black 
box" approach to the design off adaptive control systems must be 
abandoned . While "black box" approaches may lead to elegant 
theoretical results under idealized assumptions, the results of this 
thesis indicate that great difficulties arise in more practical 
settings. Adaptive controllers should be designed based upon the 
actual knowledge available about the plant. Modeling of the plant 
itself should include the following three ingredients, each 
pertaining to a different type of uncertainty [67 ] . , 

1. The Known Part - The known part usually characterizes the 
dominant inodes of the plant which remain unchanged through 
various operating conditions. 

2. The Structured Uncertainty Part - The structured uncertainty 
part is characterized by a known structure but with para- 
meters that vary with time as operating conditions do. 

3. The Unstructured Uncertainty Part - The unstructured un- 
certainty part encompasses the inevitable high frequency 
effects of unmodeled dynamics. It can be characterized 
as ai additive or multiplicative perturbation to the plant 
transfer function. Only an upper bound to the magnitude 
of the perturbation at different frequencies is assumed 


known . 
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The adaptive controller should then be designed in light of 
the new modeling information to perform all the functions of 
feedback control. Thus* in addition to meeting a reference input 
response criterion, the adaptive controller should perform distur- 
bance and sensor noise rejection, vhile maintaining stability for 
the entire class of unmodeled dynamics considered to be part of the 
real process. 

The following suggestions are offered as possible avenues of 
pursuing the adaptive control problem using the plant model and 
performance criterion indicated above: 

1. By further analyzing existing algorithms under more 
realistic assumptions, one may develop the insights 
needed to make modifications to existing algorithms 
so that the algorithms are better able to handle dis- 
turbances and unmodeled dynamics. Moreover, one must 
realize that in abandoning the idealistic assumptions 
of the "black box" approach, the possibility of such 
mathematical niceties as global stability proofs may 
be severely compromised. On the other hand, one may 
emerge with an algorithm that performs satisfactorily 
in practical situations. 
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2. New parameterizatione of the nominal control loop 
should be investigated. The three part plant 
model discussed above may lead to parameterization 
of the control mechanism which are better suited 
for practical results. 

3. It is possible that progress can be made only by 
abandoning the existing algorithms and addressing 
the problem from the beginning , this time with 

a problem formulation which takes unmodeled dynamics 
and disturbances explicitly into account from the 
beginning. Possibly, insights can he gained into 
more practical solutions for adaptive control 
by solving detailed problem formulations of simple 
first-order problems under practical assumptions. 

Whether or not results can actually be obtained by these or 
other approaches to the adaptive control problem, it is clear that 
for adaptive control to take its place as a viable design alter- 
native to other control strategies, design procedures must be 
developed which are able to produce adaptive control systems that 
perform acceptably in the presence of unmodeled dynamics and external 


disturbances. 
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